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(57)Abstract: 

PROBLEM TO BE SOLVED: To shorten a processing 
time in reducing color smear. 

SOLUTION: A computer being the pivot of a picture 
processing judges in steps S130 and S140 whether 
or not a picture element to be processed is a color 
smear picture element based on element color 
intensity with low density, and in a step S150 judges 
whether or not the picture element is an edge picture 
element when it is judged that the picture element is 
the color smear picture element, and allows a 
smoothing filter to act in a step S152 when the picture 
element is not the edge picture element, and allows a 
median filter to act in a step S154 when the picture 
element is the edge picture element. Thus, picture 
processing can be executed by reducing arithmetic amounts so that color smear can be 
reduced. 




-into 




http://www 1 9.ipdl.ncipi.go jp/PA 1 /result/detail/main/wAAAwFaOUnD A4 1 1 220632P 1 . . . 1 0/5/2005 



Searching PAJ 



Page 2 of 2 



LEGAL STATUS 

[Date of request for examination] 23.08.2005 

[Date of sending the examiner's decision of 
rejection] 

[Kind of final disposal of application other 
than the examiner's decision of rejection or 
application converted registration] 

[Date of final disposal for application] 

[Patent number] 

[Date of registration] 

[Number of appeal against examiner's 
decision of rejection] 

[Date of requesting appeal against 
examiner's decision of rejection] 

[Date of extinction of right] 

Copyright (C); 1998,2003 Japan Patent Office 



http://www 1 9.ipdl.ncipi.go.jp/PA 1 /result/detail/main/wAAAwFaOUnDA4 1 1 220632P 1 . . . 1 0/5/2005 



(19)0*8^^ (jp) 02) & H ifrF Irjp ^* (a) iummmm^mm^ 

#HI¥1 1-220632 



(43)^»a sfmm (1999) smoa 



(51) IntCl." 




F I 


H 0 4 N 1/60 




H0 4N 1/40 D 


G0 6T 1/00 




G 0 6 F 15/66 3 1 0 


H0 4N 1/04 




H0 4N 1/04 D 


1/409 




1/40 1 0 1 D 


1/46 




1/46 Z 

»3#B©»13 OL (£19 H) 


<21)ttiK#*J 


*SK*R0-243461 


(71) WHA 000002369 




¥l£l0*F(1998)8£28B 


KSCf&#HiKffi#r!& 2 TB 4# 1 
(72)«9M£ ffltBB 




♦5BJP9 -323013 


g»»UiI&*AlP3T@3#5# -fe-f3 


(32)flBfcB 


JP9(1997)11^25B 




(33)«$fe*fcfefgffl 


B# (JP) 


(72)#Hi« 

(74)ftSA #S± «t# 



(54) \smv%m nwmm®.. m&9m%&i$&zm&mwmw7vif7&&mmvitim 



(57) imm c * * - *■ 

tiXx-y^S 13 0, S 1 4 0 KT<ftfea®K)R&&A 

l 5 0(cTx<y>*iiT-fe5^g*^WiU x-r^ii 
IT'St^lc(Uf77S l 5 2{cT J Fri{k7^;i/^ 

S 1 5 4CT^->*7>7-f ;l/**fMiS-S«&i: ttc«t 



S110 




^8124 | ^-5126 



•S140 



S1S0 



S152 




IE 





S154 

/ 





J* 



5180 




(2) 



$fHg¥ 1 1 -2 2 0 6 3 2 



5 1 1 1 lci3-£-£ 4: * 5 <fc 5 tefflfflCfcTflBS LT&S 
S«HOBilte»ftfcLTH«*yi , r*lc&fc*K ±E 

-r sa^saa^© t zmffi? % c t 1 1 zmmm 

^{tfi-&i^K:S^T±Efefc: U*WR**a"r 3 c i: 

im&m 3 ] ±em*« 2 icmmvmm'ummwizss 

tit £<Dmft<D&<t&etMCM'3^T±&, 

s. 

[W*« 4 ] ±EW#3l 3 £Ett®lS&£ia&llfcfe 

-rsBftjaasBo 

mvmmmmmwias^-z, ±EfeKb#Bf&&ffi3Ms 

^wc«-^T±Efe{c u#ifi***a-r * c t *w* 
t-rsBfciaagBo 

tOI«Q®81Kfe^T, ±EiH*ia3#gMi. ±12 
SU 7c©SHS€ua»k:g|-rci:*«pai:-r*iB«J!yi 

si. 

i^t, ±EB&*Qa^j£«, xvs^nwasrrsci:* 
irnt&z s ] ±e»#ji 7 tctBM<om«mmmicts 

v>T, ±EB*fea¥@t». ±E¥jtfb«ia*fT3IElB 

(Dwmicft ltx -y s^Hwaa? set &i$st i: -r 5 
a^toagB„ 



*t*fcbT¥»{ta&a*fT-5fc*fc»K »a«*k** 
[M 1 0 ] ±EW#3i 1 ~M*JH 5 ©vvf ttfrtc 

85«©ii#5aas»tcfev^T, ±mmmmm^mit. ± 
TasKfei*^ e> sfa^^MS b fcfeHjSttK t * * 

asBo 

1] ±Efg**l~SS*«5 0V^ti*>{c 
EStOB&J&agBfcfcV^T, ±EH«Maa#gttt* ± 

•y ->*B*T?^5«^fc|l|fe{c b^Bifl£:g*Pfc bfcffi^ 
SEHOBSHSrttSii: ITSiM^^Bg^^SI 

C»Bi}l©feM)3c#fc:Bg&U x<yv>B3gT*t;i:&^*§-& 
■TSiiii^SttaSIHo 

^®Ho®m%^^bTB^5aa-rsta&fcD> ±e 
^ttj^nfefetc u^B^^ami: LTraH«aa*3feff 

* ni 1 1 «> ict^-ffis i: * 5 j; p icmnicrmft lt 
^ tc^t L-TB^a-r 5B»*aasBofci6<DB«j!ia 

40 ±EB{t7 f -^lc*5V^Tfe{cb*-B«^«ltbb, 

fete C*^{fiM-r?>fc46tcfetc b*B^S?Pi: bfeffi 
^«H©BJR*»*4:bTBI»«ia , *"*lca6fc»), ±E 

^ta^nfcfeicb^B^^a^t bri5iB«sfia*»T 
•rsc k^wufc-rsBfifcijyaJiiijwyn^A^BBftL 

[000 1] 

b Tfflft^ nz-cB^x- ^ b xmmmm-r zwmm 

so aSB> H«ffi3#afc*tra«8Mffl»7'D?7A* 



(3) 



<&r$¥- 1 1 -2 2 0 6 3 2 



3 

[0 0 0 2] 

\i\ coymwj&T'it. 023 (a) icTTs-t&Tic, m 
w&mmw&mmKttfoLTR, g, b c*, 

H^Cfe^T^ R, G, BOV^-fn^— fecDfe^L 

^S-T5®^©fefi^e»tiP B ^»LTR > G, B± 
iB-r-^tcg-^T-r ^ X^U-T tcS^f i: LT<^ 
[0 0 0 3] 123 (a) IC&^T, 

(-►) T*^-r<fS<Dfe:7-r;i/*{c;*g-f-3o ^lt, iwj 
^ (b) ictt £oic^&fr%&i£<fricyttfmrz-DTt3 

^fcoTv^^v^ffi©|iifefi^^;^ roj t-?% 

R*3«fca*G£DfefI^L"^;Wi, mm (c) tC 

[0 0 0 4] LfrU ±3SL/-ci^(C, ROfe7-fW 
*>> £ It G ©fefHttillS^tc teff&tl&V^L. G <Dfe7 

ffc£, GCDfe^-i-^^lC^jS-r^Ili^tDROfeff^tC-D 
i^Tte, f^a-Ti)ilimtcfc^^R<Dfe{i^%^^iP B lL 
Tt#?.o ?Zt, §HiiStC*3tt^G*5it>*RtDfefI#U' 
<;H4, ?hfitil2 3 (d) *5.£tf (e) KjjVrffii: 
0A^tB^5.^J:3ti:, ft.tfmtzZffitg.tft.tf 

[0 0 0 5] 

ttmz&zt^o c tit, —D<Dw$k(D-&tfift% : fflmw 
micftft-tzcticmmL, mwm**>btLtz5><5 



x 5 = 2 5m<DM^o£tKrs.^, 0 fct« ±Wm 
ZttMit Lfd§-g\ 2 5 xpj^iSi:v^^^^«i: 

[0006] ±.mmmizfrA,tf3*T%:-£nfr 

10 [0 0 0 7] 

izrm® -r & 1 1 & iz *§-®m t & 3 <£ 3 ic wntc 

c^in^%s*ph \,rzffij£%im<Dwm%:ttm£ ltw®. 
t ^Tmwmmm*mftT%wmmm^mt*mz.rzM 

[0 0 0 8] ±K<D<fc 5 tc^LfcM*^ 1 tcfrfr&fg 

ffift-$nz>t>\ ±&Ltz£v iz £comn<Dmcm<D&i$. 

mzmmt i,tzm^m<Dmm^nmt lt&iz c** 
i&m-r «fc 5 \z iii^s-r % 0 

[0 0 0 9] fe§ili^tCOl,^TfetcC*©W^^m-r 

fete c*.©^^±fecD.i o rjL<&<Dmm&.&ft\zigm? 
40 5*^, ^^i>^cr.s^fefi)t^(i> mwmmm^iz^x 

LT$>i>o 

[0 0 10] ±ie©J:3tc1S^Lfctt^2(c^§|g 



(4) 



WHW 1 1 -2 2 0 6 3 2 



[ooi i] cazis^T, ftfcc*H***a-rs* 

f*l$&^?4©-ff)J£:LT, M^3lcfrfr«ft9I&. ± 

&B3RtttH¥&ti, Sv»KM»-rsHJRIBti:i3V>T»qi 
©BJRfeSS* k«!BfiOfe7 ^ >\>$ left? &Siftfe3ijS 

wr*«/ai:LT*So 10 

[0 0 12] ±EO«fcdfc«j«Lfe»l*9i3fc:^*» 

[0 0 13] 02 3 (a) e^-T «fc b 

IC, RfeJ:tfG©fe7-<;l/**«!fiESKE««nTV»SC. 
i:A^46^-*^TV^«-&> flS&K©fe7>r;l/*H:R-? 
**fr6, I¥©B*fi«»i:tTG*»iU B#© 
i»ARG=|R-Gl ©«<t*m ■>*»»■*- SHJtSIH 20 
T'SS^So t5t> C©A R G<Dfg(402 3 (f) (Cjp; 
-TJcSfCfe!), »afr*B*IHTARGOX{t*-&V^ 

^tt3fi©BSStfc:*5t^T ro. 5J h?&K>, C©<fc5& 

[0 0 14] Wm&&&<Dm#<D&it&'£\<H£m-3\,>T 

t&t»n5^SBS<, *-©— #J£:LT, li*^4(c*> 

[0 0 15] 1EOJ: 3 KiiLfe»*S 4 t*»i>5» 

So 

[0016] f&fc>*K ±abfc«tdteftosifsftfi8» 40 

fiOM^teJU-TSo 02 3 (a) fc^-Ti^ 

(Cs i*t»LTG<!)ft7-<;l/*0«fl[WI<, R*5<t 
tfB©fe7^;l/*©ffig;!>MK^«£, &©BigfefiSi#ti: 
R, BTliSfcSM'iSCi: »«:*«. ccfcfcVT* |B]«t 

B^tcfetts b ©fem*§ u^i/*±a5-f >«K»»-r 

i:, «fS5-fy©#HiRfcfetj<SB©feffl#u^l/tt|B| so 



0 (d) ic^-rt<Di:lRl«tc*t), Ri:B©fe{l*§U^ 
;KDMARB = I R-B I = A RG fcT, 

^-rsB^rafcfeitsA RB<ofiit>iwi0 co ic^-r 

ro. 5j c©<fc3&BfSi*feK:i;#®ilii:L 
[0017] &m<Dmm&&&ti&&m<Dmm&&mt 

(*K Sitt*iei43J:tffft«>^riftOA^Flft»c|«Sfr*HJ|8|IB 
±K^{fc«^VHcg^T±fafefcC#Bfli*&ffi-r5 

[0018] ±m<D£oicmi$.Lrcm&m5icfrfr%5$ 

[0 0 19] -75. fe»cC*^rffi«-T5B»«iai:LT 

t), c©<fc3fc¥»{l3^*fT5IR©^*HHi:L 
T, M&H 6 tefrfrSSBfJti, M&H 1 5 ©<^ 

So 

[00 2 0] ±iS©<t3{i:«figLfcif^6fC^*^^ 

«»ufefeSia»%¥«Mtfiyib, 7c©B^fe 

[0 0 2 1] gjfc, ¥?tftSaafcj;t3TBfift©->-v-7 
[0 0 2 2] ±E©J:3»C«*Lfcl»*S7K)?P3^*« 



(5) 



ftffl¥ 1 1-220632 



[0 0 2 3] CO«t3tc, x^^iSMa^TdtLT 

CO 0 2 4] ±E©J:5fc*J*L;fcll3R*8fc;frfrSf8 
titf 13 fcijETili.ftfflSfcfT 3 SEHrtcDiii^tc *f LTx 

[00 2 5] fcc5T% y-ffiimmznsic&rz*). t 

9 icfrfrzftwi*. »**6 8 ©vvrna^ 
& 5 wmw-i xtf^z^m&ic mw-mitmrn-r 5 sea 

^r^#< L> raH«0-9-^X««/jN*V»*&t|B|¥»{b«l 
at - 5«EH*/J^<-rs«lfigfcLTa65o 30 
[0 0 2 6] ±EO«t^fc*J«LfcW[*9l9»Cfr*»«» 

[0 0 2 7] g:fc, feteC**ffi«TSSiJ©¥ffi©— 0!l 40 
[0 0 2 8] ±8EOd;3{c^figLrciS*Sl OtcfrfrS 



f?r£i3Il©iBjlS%*t*i: Lfcfe!Si«$NcT**<Dffi*ai 
[0 0 2 9] fefci;*BJlS*8iPi: LfcrnsESEHOBfl 

fr5t«J:, fete C*HJR*<B«oatl!igS»fc 517 

tt, ±iefet C^BfKtf x -y s?H*Tfc 5 frgfr %¥U»r 
LTxyi^BR-p**»*ti:rafeteU*ii3l6*»!pt L 

Rfefc C#Bfit<DfeMfi!c^HcBgSU i<r^ifT(i§ 

[0 0 3 0] ±CO«t5K:«lBgbfcHI**i 1 icftWlc 
fcv>Ttt. felcC^BIgtfEtttisnsi:, MttfflS^S 

So CC{C*3V^Tv X-y v ! iii^T-$)Si:*iJ»TLfc«-&{C 

[0031] fiajxtf, a • «©^Si5^tcfe»c b*®ig 
m £ * 3 fc fe{c b* ti/gri « ftoo fcfclMMi'tfi* 

^jpjwrstca&fcoTti, xy^Bjgtcfe^T&JgiB 

M8k£mV8i?Z>l3:E-rntf£\,\ tfSA,, x-yS^ffljR* 

^-CDSftfi^^HcS-^V^Tx -y S^IBjR*ipJ»f-r * «fc 3 iC 
Ut<fct/\ 



(6) 



1 1-220632 



[0 0 3 2] fefcC#ffiJR£ttmLTl£Rfefci;#iaj|S 
<, *-<D-0iJi:LT, M*J£tl 2 te<»»*»«5EWtt, ttft 

nnflK as***?* § «tj£ t l t & « . 

[0 0 3 3] Tftfc-5* jgS-fLt. 

[0 0 3 4] ±aufcJ:3ti:fefi:C#lSlR% 

U *S«»fcffl*i&SnfcttJBTfiJfl! 

[0 0 3 5] »wo®B<o*a<kffil4: LT®<ft«yia« 

9 x 7*K« b fcK»»M* JtfcfcVT t> a«K»«E U 
^JfflStlSfcVvbSfa^s.fti,-.,, ^(D—mtLT. IS* 

T»?n5 tci^-ffiS i: ft § <fc 3 tcSWfCT*! 

cam*****: Lrmm&<iim*mfiirz,mi&t: lt 
[0036] tra/u tvimmfti*. mfmmmft? 

a«ans»i:ov^Ttt^<iai3sft«!^<ra>»-efe5. zv> 

So 

[0 0 3 7] $P>tc. -WV7h^x7t*fecT, - 

osa5Ka3v>T^< Hft* t>©a:ft < , -gp^Eajfif* 



10 

[0 0 3 8] 

B#»«a5 : ?fcT»«snfcH«7*-*fc*V'»T, fete 
C»BIK««ktti LTSKfeK U^iii^^a^ t LfcBrJS 
SBH©H3g%M*i: LTfelc C^^«M-r § «fe o K Lfc 

10 [ 0 0 3 9 ] * fc, fflt*^ 2 fc^*»WtC ±tl«T, ifi 
felt. ®%lC&.lC\ZZ>-Wm*tfitii?%££tfT%2> 0 

[0040] zzic^ mm^icfrfrzKmczms, 

[0 0 4 1] IS*«4J::^*''S^{c < J;n«\ 

[0042] szic. w*9i5te^s«Ktej:'ntf, 

[0 0 4 3] ££>lc, W*«6{C^*^^JC<tn{f, 

so [00 4 4] 7 KfrfrSWEfc itUf , 

xy sWH«fr) <fc 3 (c Istztzib. W-fiHtimic <fc 

[0 0 4 5] W*5l8K^*58BUcJ:nHr, 
[0 0 4 6] ^Btc, W*q|9tc*»3^*»WK:«kn»f % 

®a^t^ t ft s B«o+j--r xtc js c tfiftisit s « 

40 g**r 3 

[0047] ^e.tc oicfrfrzftBjuc&tx 
tf, Br««SHOiiiEOfeiSJ!R»teT4'*©ffl[*fefi:u» 

[0 0 4 8] *5>t, 1 lCfrfr%&Wlc£ft 

tf , fete c»mtfxy s?iBiST**«*tem3i«Ho 

fztb. ^gp^J^lTT L* 9 c i:A^ftv\ 

so [0 0 4 9] ^e>(c, 2fcft»j^*SW»cJ:n 



(7) 



t$P»W 1 1 -2 2 0 6 3 2 



11 

[0 0 5 0] 

mm&m%mw?% 0 m i ^mo-mmmmic^ 

v^Tfefc U2MS)K£4fttti LTiMfetc i;»iS%*S*k 
Lfcm^ffiHTfefc C^^rigM-T § «t 3 teaman LT 

a^m^s 3 o ^tb^i u afl&m^sm 3 0 (*B{fe& 

[0 0 5 1] PittfflaSB2 OH:; fef= C2tfBJl6*8aJ 

[0 0 5 2] IfA^lgll OOSttWi^tCjjttS 
^fi^OCCD^fit^fc^-f^AX^-fr-^l l^r^* 
;l/7.^;l/*^7 1 2$)^V^^i:Vf•r^-^^5 1 4&k*' ! lS 
S-r^o H3«H7*5>*Jl'Xf7l/;it7*'5 1 2 O 

IMlfcM- K >> x 7«jS0d*«W^o v * Etc «fe 0 ^ L 

C C D 1 2 bfcS^tlS. CCDC C D 1 2 bBR, 
G, B#feOft7-<;l/iS»* , »H3Rf!:»JiSLTmSfl!>fiJ^ 

t?BHB^nrfe»?; mwsms&i 2 c icT&anifciotts 

SS 1 2 d fcT#iB*»c*VTiS»fS* d fctfftftv* 

y 1 2 eteffff-r*. 

[0 0 5 3] BflM0aatB2 0©JMMH(4=i:/e 

a — £ 2 1 k^— FtV 7*5 2 2 k*— Jj5— F2 3 kC 
D-R0MK7^72 4 tya-y fcf— t^T.5 F-7^7* 
2 5 t ; efA2 64^^5a>^a-^->Xf^ 

iiu Bi#tB*aB3 oo*#«ittr'jy*3 l-^-r 

^yW3 2§l*^^-r§o &*5x tfi 2 6 KOt^ 

[0054] *$zm&mc*s^Tte, mmxtimm 1 0 



12 

1 2#a«&T f --#kLTR G BOPBH-r— **W*-r* 
kkfcK, a^WTjSe 3 0tLTOy'J^^3 1 tiPi 
H-r— ^tUCMY OT>\ T-tf>£\ ^id-) 
-5 i/Hi c nicHSrinx. C M Y K co-fif-r- £ Xii 
tLXi&mt't&L. x-i-X7°W3 2tiRGBO|^li 
■r-^ATJk LT&gkfSo 
[0 0 5 5]— 7j> nvt!^— # 2 1 rtTti^U— T 
omfA2 1 a*fiK»l,T*3!K 7*V>*3 1 
10 7^rX:7W3 2K:W*SLfcyj>*F7>f/^2 1 b->£ 

f^7^wK7^2 i c^ffl^iisnr^So $ 

feu liftJaiiT' 7° U a > 2 1 dfct^b— 

mfA2 1 afc:T8lJl©*fT*:*J»S*U &HtCJfc 
UT^y F^-l^2 1 b^X^W K^-Y/^2 

i cfcjHJSbTmsoiBHiffla^fT^rso st^-c, a 

{f$aiISM2 0 kLT<DC<D3>t!i-^2 1 <DAi*a^ 
«WH\ RG B<DKit7*— **A;&U fefc C3MEJ|{* 
«WLTfeU:C*«:(S« , r*<J:3»i:ia«®l*«iLfcR 
GBOBif- *S:#figU f^^WK7l'M2 1 

'J F^/^2 1 b^LTCMY (SSWiCMY 

k) ©-fflx-^fcajftLT^y 3 i KBisds-e* 
[0056] d©i3tc, **«yg»t«i,^Ttt, 
B^jaa^fT 5 «t -5 tc l t v s t>\ ^-r i/imnv 

fcfa-^S/7.-rA^r^Si:-r§^>^T-(i^<, 

C C DlcTffimztiZ 1 1 tlc±^Lfc«fc 3 (cMMttff 

$>i> 0 0>J3Ji\ ^4 tC^-f i^^#«S©C C D^rffli^ 

^SWfa7*W3 2 afc^^-^fc^^y >^ 
3 1 atcEP^^-tiS i3Si/XfAT^Ttai>o S 

Ck^<ffi«7 s -^^A*LTEnBiJ-r^7 p y V^3 1 b 

1 1 b-^xv^l/X^l/*^ 1 3 bH^LTA^I^ 

[0 0 5 7] ±3zELfcfeKC#Big©&mkfelcU#^ 

fiw-rsifflttMBiatt, **wt«:t4±e3>trjL-*2 i 

{C T 0 6 & k* jS-T 7 n - 3- * - h tc ^JCg L fcli^Sa 
so 5aiiW^k^§®fix-^lCOI/^T, 07 (a) *3«ttf 



(8) 



WBB¥ 1 1-2 2 0 6 3 2 



13 

(b) Ktt&bK-mmoymtistf-Jxnvv 

mmiciivr®tp®mmft-V7K?m— imx<d 

m% s t it, mm?- 1> co&mm t c c d <D&wmtf- 
tt-T-fljSLT^ntf, mm?z> c c DOiS^fc^i; 
xmm^x^mmicm^^t>\ m-wm$i<DccDz 

sti 9, *•>*•> SH-&& -Sty t><Dfc-rs 0 
[0 0 5 8] 0*>6tWe>35)^<J:^fc, |WJ — tMXOT 

xtfaft n « ¥»fb»a £ n s ibb l t 

{^tiLtH, 07 (a) iCTjir&vicmmtt 
z-£<Dmt&tf¥-mimmznz,ct$>&tLi$, mm 
(b) ic*?£oic¥-mimmzn%mwt>m@i±mc 

A = m i n (height, w i 
C CtCfcl^T, min (height, width) li 
heighttwidt h «DV^-ftx*vjN^ VT^^rj&^-T 
S 0 ^ LT, Xf'^S 1 1 OT'I^ 
A<3 0 0&p>1£, 3X3H^O :s F?t<b7-i';I/^ 
3 0 0<A<6 0 0&£>(i\ 5 x 5 mf&<D*?i%it7 4 

A>6oo&e>(±\ 7 x 7 mfgow-mity * fr* 
tv^j^fc^u ^ti-rnx-T^xs 1 2 2—7.T- 

■yys l 2 6(cTfflv^S s F?t^7-i';i'^coaiS^y-^ 

OR AMT-JjotfeJc^LA- Kf-i'Xi' 2 2T*£oT 
[00 6 1] lC T?m in (height, widt 

-®5g&©W#7*— *T<fcoT*>09 (a) tc^-reV 
h^v 5 EfiJK©M«fc*ttti\ WBI (b) 

A R B = I R-B I 

[0 0 6 4] #lfe&&£ggtC*5ttSCCDl;i:0 2 3 (a) 
lc^-r<k9tC, ^BlgtC^JSbTR, G, B©&fe©fe 
7*/i/*tf**r^*ttteB«£ftSfcfct>tes G©fe7 

5, RfcitfBO^-^l/^tfiSffififcfcTPT^So * 
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ttLT^&SIU^tf^^&oTLSSCttf&So ¥ 

nutvmtzt^sc tit, mmz&wz&zzL tic 

®%t~>%;^frb, mm (b) lc^-Tt<D{c*5V^T«iS^ 

[0 0 5 9] =tCX\ ^t^BWc^Xlt, 08K^ 
•T<=x5tC^3X3, 5X5, 7 x7mmt^r>tzW&<D 
gf£Z-V-4X<D¥-mit7'fA'$ZVm LT*5?K h®-9- 
XtcjS CT c n 5>©¥»ft7 ^atffiv^tj S 

10 X^fUJTTS Tti, ®««D (height) x 

(width) %stu bTiBjR»**a&, t(D»fj?n 
-ttxmznz Aic'&z>TW£ttnmm<Dmm j v-'( 

[0 0 6 0] 

d t h) - (l) 

ST St>©i:-f St, M#T|i5-©¥i#ffc7^;l/*#>S 

K^nsctic^So -rstx wgias^xizmw-ffiik 

c©i5%S^ ^MftictitfWfcBifi^ttSc ft 
oT. heightfcwidt h <D^~f tlfr'i^l^Z: 

So 

[0 0 6 2] 06©!7n— f+-h?;#It5t< 01 

7-ziz^Tmmmmmz7k¥-j5\tiiic3.7£&\,-D-D 

[0 0 6 3] Hflfc-r— *stfKv hvhi»^xt»ccDiii^ 
&*Mi£ttTV»S»&K:«\ S-iUStCfctcRG B©(5gSi 
x— * ( T0J ~T2 5 5J ) T*?nt^5„ Xf7 
XS 1 2 2-X-r-yXS 1 2 6 ICT^fflf S¥mft7-< 
/l/£©««£7-*xy7tc{5l#Lfc£K M5Xf7 
Xs l 3 0te*v>T«: % ^iii^i:-e<D^2IH^{c*5^ 
SRfe.tt/BCD^iS-r-^cDM^A R B^gffi-TSo C 
OARBti, 

- (2) 

v^TfgffiJSOR, B©pgp-r-^(co^T. 

* if«©fi*feJ«»K: «t t) fete S tv^c 

ttf-etSo 

[0 0 6 5] $fc, fetcC^t±^{cS • HMO^EW^ifi 

**(DRGBOB«7*-iitt (R, G, B) = (2 5 
5, 2 5 5, 2 5 5) i*5fc£!5» ttHiUdlOtSX 
so (R, G, B) = (2 5 5, 2 5 5, 1 2 7) t^-Dtc 



(9) 



^HfFP 1 1 -2 2 06 3 2 
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5SS»«K:»5 c fctf T**fcfcft<Dfej£##5S£-f5 

^P»{fARB« roj t4«U i^aitsi^ti 
RBti roj fcftSti-fTiifcStf, fetcC^Hfgfiiis 

r. 

[o o 6 6] trSA,* B®-r— ^tioTatttiR 10 

A G R = I G-R I 
A G B= I G-B I 
£ V» 5 ^{c^#-T Set fc?M6?* S c 
[0 0 6 7] CCOi-p&A R BCD^tS-B-V^ll 

i&.mm<D&74;\'$fctti£,?z>wmm-vb r B<om<m 

E = 4 A R B (x, y) -2ARB ( 
-2 A R B (x + 

tk^-r^c f Lt> E £ T h ©**KfeK: UftBiJRTfe 

l^Tti, *iJS«*OH3RK:a3»*ARB (x, y) 
«>Tfe< ^321i^(DA R B«Dffli:LTA R B 30 

(x-1, y-1) *5«fct>*ARB (x+1, y-1) 5: 

[0 0 6 9] E^Th©¥iJ^S*PfctJeoTfetU*iB3g 

M©ARBffiOgflA&V»tf*#<fcSfci{> (5) S% 
|g^.fc:^fcfe^C*H3Ri:¥iJ»T-r«c Sfc, (5) 5£ 

tc»j?p*o cct, 023 (a) %#^-rn«\ 

C 1 = R — Y 
C 2 = B- Y 

[0 0 7 2] LfrLfctffc* RGB«DK»7*-*ttit» 



l4IR«:^©iajB-p*53Jp6s MfMXIHIT&R BcD^fk 

H\ «a^**?teUTA!Ul«*iillRi:«iflia*i:OM 
T-ARBOffiOgftg-^V^lSK raXfkft^V*^* 

/S»*aipkLT (2) 

- (3) 
... (4 ) 

[0 0 6 8] *IS©feK:i;»ili*©«tfH*;*f t y:7 p s l 
4 OfcTfr'M'U C©7.x-;/:/S 1 4 0"e(i±iecDJ;3 
lcLT»m Lfc A R B©JBaiHJRMT©g<tat&l^€> 
fee C*HSR*^^OJpJS«rff -5o c©£^ 01 l fc 

x-1, y-1) 

1, y-1) - (5) 

*<ffiffifi©s?jRfefc»is-rs»&tt, »»rsfi«flco 

BfSfefcfcfJS-f Sil3Sifc©llfl-T?A R Bfit©^{fc£-&V^ 

ik w«^©Bjfij^ffiaE<oB3i5feK»jsrr*»& 

ttx »»"r*Wffifiofi*feK:»(S-r*lffliR4:©nB'PA 
[0 0 7 0]fct, Xf-y7"S13 0, S140(CT 

sv>tc»»-rsiBjisiiatefe^Tfi«*©fe7-< , ;i/afK» 

[0 0 7 l] 7f-yys 1 4 0(CTfe(CU»BlKT%« 
fcflDfcfflWLfcii^fctt* Xt7^S l 5 OtcT^KiB 

5***wwr*»ca&fcoT»i, fe*i«»»ca^v»Tff3 

fig^Cl, C2$r##>3o ft33, C©6i^Cl, C 
2«, 

- (6) 
- (7) 

vaifesiiBtefessi-rscttBiisiTfts^ ssgsfc 

H<0»£fcfiJfli*ftT^*R G B^6Wfi*ifi»i:*i&* 



(10) 



<&ffl¥- 1 1 -2 2 0 6 3 2 
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Y = 0. 3 0 R+0. 5 9G + 0. 1 
[0 0 7 3] xy2^XttB«©*!M|S#T?a&S**e>s 

I C 1 (x, y) -C 1 (x- 1 , y 
I C 2 (x, y) -C 2 (x- 1 , y 

[0 0 7 4] (9) fc^tf (1 0) ^.(DM^k 

■T*fcC5a, 0 1 2tcjjVrJ:Mc, HSKfete C2MBJIS 
bfc h U * *#4)H)Rfr 

1, C 2©a<b*^l/">**«> % ^fntt^fTh 
1, Th ZWJifcSfrSfrfcWJSLT^SCfctcfl&fcB 

mammim 1 3 tc^-r ± 5 »cik«»c^-b«ke«* 20 

MKi, C 2 <D^{b*^*#i& Statue , ^ti 
fniS^Thl, T h 2 fc©HT?tfc«8MSU ^-f 

n^-oott««w»j:Tfeaifi»c 1 Septic 2©^b 

I Y (x, y) -Y (x- 1 , y- 1 
C<D ( 1 1 ) *&XyS^*©¥iJ»rS*l*fcLTfflV'>tl 

«\ (9) jBjitf (1 0) s^ffl^sw&teJt^rwn: 

[0 0 7 7] 7,7-V/S 1 5 0 KTSKfefc U^Bfgtf 

S l 5 2T-|^fe{cU*Bs!lfc;ttLTX-r-;/7 p S l 2 2- 
Xf 77"S 1 2 6teTtt*Lfe¥itft:7*Jl/**fM!« 

oTfi, fegfi£#©¥ra<btf*#iT*;&£fci&, **SSi^ 
*S{C*5l^T«±83 (6) , (7) mcm-3^Tmth\^fc 

feMj£#c i . c 2 icftLzy-mimmznto 
[0078] zcx\ ¥-&<t7'(j]'$%m^rz¥ffi{tm « 

fflg***HJI6©ftKjS#c l , C2 0l»(«fiti:u * 
o« 23B*t{c ** L T IW iffb 7 f ^ * <W S £> IS 

C 1 ' ««^BOfeg«»C 1 % 
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B - (8) 

1 ) I ST h 1 

- (9) 
1) I >Th 2 

- (10) 

fi-^tfL^VMlT h 1 $/c(iT h 2«±«5i^tfe 

[0075] c(D£5ic&iz\zfrwmtfx.vz;mmr°& 

nfcfi^T&ajsR^-C 1 , C 2 KOl^T©J*RWJ|*fT 

[0 0 7 6] &tc, x-y^HUSTfeS^g^WftfiJE 
©^/jN-pflWr 3<fc-5tcLTfc<}:<, C <Di§^fC « _hi£ 

Lfc o) fecfcu* (i o) a*3fca*ctt«rn«r <fcv>„ 

I ST h 3 

-(11) 

[0 0 7 9] &M<D£.5lcmm j r—$<D£mm%*i3i£ 

[0 0 8 0]—^, Xv-yfS 1 5 0 T*^Kfe(C C*® 
^frx>y ^iB^T'feS tnm Ltcm&iCl}. Xv-^ZfS 
1 5 4 T-Isieuc C*BJ(S*tf 4>t LT 5X5 BiSKD* 5? 

gi*&<x 3 x 3iij^o^i/*7 T >'7-i';l/^^:jgffl-rs^ 

H3»easHRni6Ta&*. ?ct\ gjw<Dfiia±, 3x3 



(11) 



nmW- 1 1 -2 2 0 6 3 2 
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5. 

[0 0 8 1] 09*. If, m 1 6lcm?£olC fetcb&B 
mZtpfct Lfc 3 x 3Bf?t<D K-y h U ^X£%S§-f 

x 3 mm®* si -< fr* zmrn? % 1 v»3 c tit. 

L, 4"*©ffi£S^LTfe{cL#Bsil<DfeME5i#C l t 

ic^rit, fegj£#c ri oj ©BSttfAB 

^#&u r 4 0 j (Dmmtf—wm&tEL. riooj 

f^i:, mm^$>W<bfr-&£5lr:tp$:(Dmte ri oj 
fcfct>, lKfefcb#Bfg<DfeMfi£#c lit ri oj £ 

[0 0 8 2] — C C tc*3V^T 3X3 Wm<D¥-ffiit7 

-<)\<2ttftmz&rct>(Dt-?z>t. 9\-s<D&9m r3o 

0J *ifi£ft T9J mSLfcffl-p^i. T3 3J 

gis^c 1 ' it&i£K&wmicMLTmmwm<D&mi& 

W&T—$ik:LT^2>£tlC%:2> 0 C<D& o ic LTrtB 
frtc L & £>«: i^fc>tf> £> a — / 7 -c ^r*Htfc t © 

[0 0 8 3] aw, ia 1 6*mmir2>t, &mi$.ftc 1 

©filtf T4 0J ©BJ*^TfeteC*tf«£LTV»SCi: 
Jb^^So ^CT\ COfe{CU^Hi^{cWLT3x 3® 
i©^^7>7>f;^%lfflt5^ AffiJR© 
fT-fcH*©fel6JiK»Offi^ rioojt^O, — BJR 
0*fei6jK»Offl[«< ri 0J T*&5fci&, ^KfeKL* 
ffl*©&gia$te><it> ri ooj te«#»t>«ci:te* 
0, feicC#aM6M£*iSCfcjb<#frSo coddle. 

* V>7 J ;b^tix y S?SP»*tf Jf>tt v»«fc 3 fc 

Y ' =Y+ (Y-Yunsharp) 
t LTmWStlZo C C T% Yunsharp tifefC L^Bfit 
©iff- £ tcM LT 7 y is * — 7°vx * Jaa^rfig L fc 

*neg^tc*3v^T(is iai stc^-r ^^tc3 x 

3, 5X5, 7 x 7M«iiP6ftS3(Bj07>i't-y 
VX^filATfc'K ^tl^nXx-y^S 1 2 2~S 1 
2 6TifcSLfc¥»ft7WVb*©1^XlC»j£l/rv> 
S„ 0H*fcf, 3x3B^O s F?t{b7i'^^S^bfc 
5>, 3 x 3B^CDT^^-^— y-TX^jHR-rsctlC 
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LOO, fe{CL^^6M^^i.^m?r i E>WLT*5t», ± 
gEOXx^XS 1 5 0tCT^Kfe{cL*B^X>y->*B 

[0 0 8 4] &33, CCTM^Lfc^TV^^fci: 

3x3Bists5^, &3A„ *mmBmizTmm-?% 

5 x 5BX0^^7>7^;I/^0«^. ^~+EB^© 
-pf *«Dffl*iBW'mtf «fc < , 3 x 3B^«ja-e-t^ 

10 V>TflJ^Lfc*\ feMfiX^C 2lCOV>T^Pl«T'fe^C 

[0 0 8 5] t<:3T% ¥rt<k7-f;b^fc^^T>7-i' 

* ps o »* fc7?^«ias«±^ e> t & s o x y 

B^OWHSS^^LT (9) 33J:a' (1 0) SfcSffl-T 

5*^-, -feM^c i , c 2 ©v-fti*^— >er-eras*^E 

fcfttf, feMfig^C 1, C2£D^T'|W)iC 

^^S-Ti.fe^«-tC*5V>T©^X'r-y7 p S 1 5 4f 
^i^T>7-i';l/^^rji^L, giJ<D— ^©fe^fiK^-tcov^ 
TtiXf-y/S l 5 2T- 3 F}f{b7>i';l/^^igffl-rntfm 

x-yS?BJ|S(0«»fSqii:LT' (11) S^^ffl-TS*^- 

fcci:«*iJWfLtf*Wc46, co^ic^x^^XS i 

5 4T-felif£#C 1 , C 2<D^(C«LT^^T^>'-i' 
so A/**jSffl-f SCfcfcfcS. 

[0 0 8 6] ±izELfci5tc, fe{cL*^{6Mfi)i:v^ 
^Ciili, Bilt*Jff63^fcLTfeteC**B3ifeia:<-r 

sHiti^L^o ^c-e, ^mmmmizts^r 

It, M5XT77S 1 6 0JCTX>yi?^ifiaa«:fT 
[0 0 8 7] C©x*yS^fiHfilffl«, 5ilitu©^B*<D 

s*laY^c^ttLT3Sli^t(D®SY• ^ 

- (1 2) 

*s 0 cn<E>(D7>>'^-y^x^i>±^i,rcw-mity 

■oVZtmMlc, (fi*oaffl«:*B*Kfe^*Y (x, 
y) (OasWtit, ^"OJliaB^tc^LTIWIvxy© 
3H- S fetj t JtJiS L fcM*f?r«-* L T«g-r § © 

[0 0 8 8] 

[»1] 



(12) 



ttrHPF 1 1 -2 2 0 6 3 2 
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Yunsharp= (1/13 6) Z (M 

i . j 

%%'&w3.fcm-3^Tmw?%c <:© (13) 5^*5^ 

T, Tl 3 6J fctt«#tttt«a©£fMBT?fc»>, 

•^fHItftSo f 5 x 51S}RTa6tlff T4 0 

0J t§5U 7 x 7 MJR-CS&ftlf rg 0 0J fc&3 0 
Sfcx Mi j liT>->-V-X^X^©31-eiC|B«$nT 10 

v^«s»tt»rtMK'p%tK y (x, y) it&mmicisi} 

[0 0 8 9] Yunsharp (x, y) It&lzVfrWmiCtt 
LTJS3ZZH3l6©«*#tJ%«< LTinJH,;fc&©T?&3 
fr£>, C©Jt-&fe|B]«(CD— ^X^^U^fcaHtfcfctQ 
illRlUiSlftfeV^^Oo t^ot, TY (x, y) -Yun 
sharp (x, y) J fc«**<D£fi£#fr£teJ8i£jiJi#* 
§ I ^fc C t IC & r> X> W / ^X 7 -(* ;l/ £ £tjW & CD t |W| 
m<DMM&^%:&-Do fit, /W^X7-c;b^^jliS 20 

LfecoiSMttj££% ry (x, y ) j icm^nimm 

& o THHi© > -v — X£ * s (pJ±-T 3 c 
[0 0 9 0] &*5, CtlP.C07>->t-yvX^ail 

(1 3) s»T?jS*n*vh»j*x»»i, «ra*HfcHi 
mmic^xit. ^tbmmMconfrttim&itm^xm 

fiScbfc3x3 N 5X5, 7 x7mm<DT >i/-Y—-?T X 
[00 9 1] £C3T% aWftSSJBJStcfc^Tti, sp»fb 
B 1 9 T-iiVf If <y h v >y TTS^lc 0 (f *M»S#T jjVT « *o 

w-mitmm-$nx!kt>titc ->+-yj stoT 

LTLS3ci:A^fifeU9So c<Dfc*b, *&M&mx 

itw-mity j £ t > -> * - x * »m x £ 
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ijxY(x+i.y+j)) 
- (1 3) 

[0 0 9 2] X^-yXS 1 6 0T*«±ie<£><fc'5&x-y V 

3Sw«rai*fT 5 1 i: t. k » &m&qi*a y * t mmmo 

feilS^fflV^O (6) ~ (8) 5£lC«-3^TR' , 
G' , B' OB«f-*t»5, "f Xf-y^S 

15 2, SI 5 ^CTfelCCa^fSM-rSi:^^ X 
T77S 1 6 OKTPgtS-r-^^fiScLTfc^ CtxS 
^Hfft 5 K •> x T«« i: V 7 h x T t lz <k o T 
ilif*«yi¥8**|j«-*- 5 C t ic S„ 

[0 0 9 3] &*5, X-r>yXS 1 6 OlC^T, 3£iHL 

fciw*Y' cta^R* , c . b* vmm 

^-^tfftcDffit&ofcO, r2 5 5J KM*.**?*; 
mt&ZCttf&Zo LfrU KWHifcLTW:, roj 
~ T2 5 5J «D«SI?*5ft», AOPiSl^— & 

tc roj r2 5 5j srs* 5 rsif-^ a—me 

T2 5 5J tt5„ LT, ^OXf77'S 1 7 0{CT 
Jail^a^^Kl^^ X-r-yXS 1 8 0(CT^®^ 

•To 

[0 0 9 4] i:C3T% fete C^Bi^^tf LT^m 

is. w-ffiitmmic&^x&izKfrtfi&mzti, i-y^ 
ifflffl^ns. tot, **WKttfetu»iia«xv 
Lx—mzfrfrz>mm*nnirtii££ < , c©i5^« 

L$ 3Ct o /ci6, fete C^B^^x -y i^iiilgT? 
[0 0 9 5] C Cf, **SSJg»©iF?IMt«yffi»J:tfx 

yimm9m<o^mc-o^x, mm^—-k7t<D->=3. v 

— ^g>*7*;U*tRI^LOOBiWrSo 02O(i> x-y 
^ISMIl^T^^V^-g-oD— ^7t;-> = x U— v-3 

0{C*5V>T, feSfficDR, G, BOThU^XtiCCDcD 
fe7Y;l/^BS?iJ ; Sr^LTV^i 1 o c^vMJ^X<DfeR{i: 
yjk? ri NJ »43ttOXi#«iJi*SUT43») % ri (pgDS 
f^-^l±2 5 5) J 45tf^*ft9TV^, -T^fe*. 

rej ^««u ro (PgiB^-^tio) j 4 6tf 

[0 0 9 6] C CT% *5R-^7t(DE?lJT'%^-r^^^ 
T'«fe§^ Klfl*fBB8{b-r*fcii)x ±IER, G, B© 



(13) 



If 1 1 -2 2 0 6 3 2 
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ufcwgfree-aoajWjftte^n^tiG cb) = 
o. 5, r = o. 5fcv^«fc3teft<Dfi<l*tff8£U 

m^ns. &KC#iS}is^*m*ns4:, (6) ~ 
(8) afcttoTftaaa-c 1 c 2««jras*u 

r , C2* w#e>nSo &*5s tcrii- ^7£©¥?t 
fb^/l/^i: LT ri.i.i.i.i.i.ij %iSfflLTv>5 0 
"Tfcto^ ffiS!^iliJR©t(l«*n^n©=lH*©ffi* 10 

«*^wlt r7j Twsjr-rs. tbT, f#e>ti/ifeM 

fI#C 1* .' C 2* '* (6) ~ (8) SCteS-^^TTC© 
feft^KR.U ¥»ffiIi^OR* , G' , B' 

*5tt3 (R' , G' , B* ) ti^n^tl (0. 7 5, 
0. 61, 0. 61) t> (0.2 5,0. 11,0. 
1 1) fc&tK *3fc<D r I NJ ©ffitCjfi-^TfetCl^ 

[0 0 9 7] 02lli, ¥»<b«^*fT3i:i:t> 

»Cl, C 2*#»T¥»ffc^*fT3 c£«±i£Lfc 
tOtffiatt'*lr-»*\ (6) ~ (8) SC*fflV»T7£Oft 
^{CM-rigtC. ri,6,18,25,18.6.1J oa*WJ*Sf 
lH£tz-2l7t(DT V - :/ v x 7 L T3fiW«ia 

jfiOHHttCfctfS (R* , G' , B* ) tt*tl*tl 
(0. 8 1, 0. 6 7. 0. 6 7) (0. 1 0, - 

0. 0 4, -0. 0 4) t%%o tSZA,, RGB (Dim 30 
ttfcl/Ti:!)»«ffl« roj ~ r 1 j T'&ZfrZfrZm 

R»ctt»*07*-*tt (o. io. o, o) t*i. m 

[0 0 9 8] ££fc, 02 2ii, ¥ffiit7 J 

8Hc^LTl/^&o COi^ — #l7t<D ri, 11.25, 11, 1J 
i^d^mfb^^©-?-!^ (7«j) <fc£t>/h£^5 

©iBjRtefe^* (R' , g" , B* ) fi^-n-en (o. 

79, 0. 65, 0. 6 5) (0. 10, -0. 0 
4, -0. 0 4) C©<t9tC, 02 1C^tt 

<DtcJt^mi\ feteC»©»?ligfiU:£*t><z>©, ^2 

[0 0 9 9] ±BE*tffr&****»mJB©l&flF 
*7 1 2TflM»tfc*IS«*=i>tra-* 2 1 l£i&93£ so 
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A/C\ -7V>* 3 1 fcTBlgiJ-rsii^SJt-rSo "TS 

xA2 1 atffS«LTV»Sfci:T, ■tMUlT^U 
•>3V2 1 d r^^X?-;!/**^ 1 2fr 

yy->^fA2 1 a^LTiiifSSaaT7 p U'5r— >g> 
2 1 dfc«l»Ji&Stlfc6, Xf77S 1 1 OlCT (1) 

U Xf77S 1 2 2~Xx^7 p S 1 2 6tCTtefflT& 
¥jflb7 -r *5 £ 1ST y ->-* -TVx ^ co-9--< X^ri* 

[0 10 0] ?LT, Xf'^S 1 3 0teT«U!2t*iH 
JR*«JJW{fc«*cKJ£U (2) sSfcSe-aTaKBJRi:* 

f'V^S 1 4 0fcT (5) 3Zicm-3^TW&Stt£mmt 

^ m«OL*v»ffl[Thi:Jt«bTRISEfb*-&v^** 

[0 10 1] fetcC^Bi*i:*iJ»T^nfce», Xf'y7"S 

1 5 01CT (6) ~ (8) SeKS-3^T5aa*f&«fS:fe 
itf^-<Dfflffliffl^{COV^TfeMfi!c»C 1 , C2*Iffi 
U (9) *5«kt>* (10) (11) 
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CLAIMS 



[Claim(s)] 

[Claim l] An image processing system which performs an image processing to image 
data which consists of a pixel of the shape of a dot matrix filled up and generated by 
operation so that it might become homogeneity density, while a color filter of two or 
more element color characterized by providing the following picturized with a solid state 
image pickup device of a veneer arranged in the shape of a mosaic by non-homogeneity 
density A color blot pixel detection means to detect a color blot pixel in the 
above-mentioned image data An image -processing means to perform this image 
processing on the basis of a color blot pixel by which detection was carried out 
[ above-mentioned ] in targetting a pixel of a predetermined range on the basis of a color 
blot pixel for an image processing in order to reduce a color blot 
[Claim 2] It is the image processing system characterized by detecting the 
above-mentioned color blot pixel based on a change degree of element color 
reinforcement to a color filter of low density in between pixels which the 
above-mentioned color blot pixel detection means approaches mutually in an image 
processing system of a publication to above-mentioned claim 1. 
[Claim 3] It is the image processing system characterized by detecting the 
above-mentioned color blot pixel based on a change degree of difference of element color 
reinforcement of criteria, and element color reinforcement to a color filter of low density 
in between pixels which the above-mentioned color blot pixel detection means adjoins 
mutually in an image processing system of a publication to above-mentioned claim 2. 
[Claim 4] It is the image processing system characterized by detecting the 
above-mentioned color blot pixel based on a change degree of difference between 
element color reinforcement to a color filter of low density in between pixels which 
adjoin mutually when the above-mentioned color blot pixel detection means has two or 
more color filters of low density in an image processing system given in 
above-mentioned claim 3. 

[Claim 5] It is the image processing system characterized by detecting the 
above-mentioned color blot pixel based on the above-mentioned change degree between 
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pixels of low density which the above-mentioned color blot pixel detection means adjoins 
mutually in an image processing system given in either above-mentioned claim 2 - claim 
4. 

[Claim 6] It is the image processing system which the above-mentioned 
image-processing means carries out data smoothing of the color difference component 
which subtracted a brightness component from an element color component for a pixel 
of a predetermined range on the basis of the above-mentioned color blot pixel, and is 
characterized by returning to the original element color component in an image 
processing system given in either above-mentioned claim 1 - claim 5. 
[Claim 7] It is the image processing system characterized by the above-mentioned 
image-processing means carrying out edge enhancement processing in an image 
processing system given in above-mentioned claim 6. 

[Claim 8] It is the image processing system characterized by carrying out edge 
enhancement processing to a pixel within limits to which the above-mentioned 
image-processing means performs the above-mentioned data smoothing in an image 
processing system given in above-mentioned claim 7. 

[Claim 9] It is the image processing system which is characterized by to make small a 
range which enlarges a range which carries out the said data smoothing when size of an 
image used as a processing object is large, and carries out the said data smoothing when 
size of this image is small in performing data smoothing for a pixel of a predetermined 
range on the basis of a color blot pixel by which detection of the above-mentioned 
image-processing means was carried out [ above-mentioned ] in an image processing 
system given in either above-mentioned claim 6 - claim 8. 

[Claim 10] It is the image processing system characterized by for the above-mentioned 
image -processing means to replace a color-difference component which has a central 
value of a color- difference component which subtracted a brightness component from an 
element color component for a pixel of a predetermined range on the basis of the 
above-mentioned color blot pixel by color-difference component of the color blot pixel 
concerned, and to return it to the original element color component in an image 
processing system given in either above-mentioned claim 1 - claim 5. 
[Claim 11] In an image processing system given in either above-mentioned claim 1 - 
claim 5 the above-mentioned image-processing means A color difference component 
which has a central value of a color difference component which judged whether the 
above-mentioned color blot pixel was an edge pixel, and subtracted a brightness 
component from an element color component for a pixel of a predetermined range on the 
basis of a same color blot pixel when it was an edge pixel is replaced by color difference 
component of the color blot pixel concerned. An image processing system which carries 
out data smoothing of the color difference component which subtracted a brightness 
component from an element color component for a pixel of a predetermined range on the 
basis of a same color blot pixel when it is not an edge pixel, and is characterized by 



2/28 



Japanese Publication number : 11-220632 A 



returning to the original element color component after that. 

[Claim 12] It is the image-processing method which carries out an image processing to 
image data which consists of a pixel of the shape of a dot matrix filled up and generated 
by operation so that it might become homogeneity density, while a color filter of two or 
more element color was picturized with a solid state image pickup device of a veneer 
arranged in the shape of a mosaic by non-homogeneity density. An image-processing 
method characterized by performing this image processing on the basis of a color blot 
pixel by which detection was carried out [ above-mentioned ] in targetting a pixel of a 
predetermined range on the basis of a color blot pixel for an image processing in order to 
detect a color blot pixel in the above-mentioned image data and to reduce a color blot. 
[Claim 13] While a color filter of two or more element color is picturized with a solid 
state image pickup device of a veneer arranged in the shape of a mosaic by 
non-homogeneity density It is data medium which recorded an image -processing control 
program for an image processing system which carries out an image processing to image 
data which consists of a pixel of the shape of a dot matrix filled up and generated by 
operation so that it might become homogeneity density. In targetting a pixel of a 
predetermined range on the basis of a color blot pixel for an image processing, in order 
to detect a color blot pixel in the above-mentioned image data and to reduce a color blot 
Data medium which recorded an image -processing control program characterized by 
performing this image processing on the basis of a color blot pixel by which detection 
was carried out [ above-mentioned ]. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] It is related with data medium which 
recorded the image processing system, the image-processing method, and 
image-processing control program which carry out an image processing to the image 
data picturized using the veneer-type solid state image pickup device. 
[0002] 

[Description of the Prior Art] In the digital still camera using a solid state image pickup 
device etc., a veneer method is adopted in many cases. By this veneer method, as shown 
in drawing 23 (a), corresponding to each pixel of a solid state image pickup device, the 
color filter of each color of R, G, and B (red, green, blue) is arranged in the shape of a 
mosaic at a predetermined rate, especially the color filter of G is arranged alternately 
and the component ratio is high. Therefore, in each pixel of a solid state image pickup 
device, only the chrominance signal of any 1 color of R, G, and B is acquired, and the 
chrominance signal of each color cannot be acquired. Then, the interpolation operation 
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of the chrominance signal which cannot be directly acquired in each pixel is carried out 
from the chrominance signal of the adjoining pixel, and the chrominance signal of R, G, 
and B all color is acquired, and it changes and outputs to gradation data, and is carrying 
out displaying on a display based on this gradation data etc. 

[0003] For example, its attention is paid to the color filter of the middle shown by the 
arrow head (->) in drawing 23 (a). And as shown in this drawing (b), light shall have hit 
the left half from the center (white portion), and light shall not have hit a right half 
from the center of said (black portion). In here, if chrominance -signal level of each color 
in the condition that light has hit is set to "1" and same color signal level in the 
condition that light has not hit is set to "0", originally the chrominance- signal level of R 
and G should become the value shown in this drawing (c). 

[0004] However, as mentioned above, the chrominance signal of G is not directly 
acquired from the color filter of R, and since the chrominance signal of R is not acquired 
directly, about the chrominance signal of G of the pixel corresponding to the color filter 
of R, it carries out linear interpolation of the chrominance signal of G in the adjoining 
pixel, and acquires it from the color filter of G. On the other hand, about the 
chrominance signal of R of the pixel corresponding to the color filter of G, linear 
interpolation of the chrominance signal of R in the adjoining pixel is carried out, and it 
is acquired. Then, the chrominance-signal level of G and R in each pixel serves as a 
value shown in drawing 23 (d) and (e), respectively. A fake chrominance signal occurs in 
the pixel near the boundary of the field where light hits, and the field where light does 
not hit, and a color blot occurs on an image with the chrominance signal of this false so 
that clearly also from drawing. It is known that especially this color blot will appear on 
the boundary between Gray White notably. Then, in order to reduce such a color blot, 
the smoothing filter (low pass filter) was made to act to the color difference data of all 
the pixels that constitute image data, and it was carrying out it not being conspicuous 
and carrying out a color blot etc. 
[0005] 

[Problem(s) to be Solved by the Invention] The following technical problems occurred in 
the Prior art mentioned above. It will be equivalent to distributing the color component 
of one pixel to a circumference pixel to make a smoothing filter act, and the matrix 
operations centering on this pixel, such as 5x5 etc. pixels, will be performed. For 
example, when performing a 5x5-pixel matrix operation, a 5x5=25 time operation will 
be performed per pixel of 1. Therefore, when aimed at all pixels, it might become a huge 
amount of operations called the number of 25x pixels, and the processing time might 
become great. 

[0006] This invention was made in view of the above-mentioned technical problem, and 
in reducing the color blot in the image data picturized with the veneer-type solid state 
image pickup device, it aims at offer of data medium which recorded the image 
processing system which can shorten the processing time, the image-processing method, 
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and the image-processing control program. 
[0007] 

[Means for Solving the Problem] In order to attain the above-mentioned object, 
invention concerning claim 1 It is the image processing system which performs an 
image processing to image data which consists of a pixel of the shape of a dot matrix 
filled up and generated by operation so that it might become homogeneity density, while 
a color filter of two or more element color picturized with a solid state image pickup 
device of a veneer arranged in the shape of a mosaic by non-homogeneity density. A 
color blot pixel detection means to detect a color blot pixel in this image data, In 
targetting a pixel of a predetermined range on the basis of a color blot pixel for an image 
processing, in order to reduce a color blot, it has considered as a configuration equipped 
with an image-processing means to perform this image processing on the basis of a color 
blot pixel by which detection was carried out [ above-mentioned ]. 

[0008] In invention concerning claim 1 constituted as mentioned above, image data set 
as the object of an image processing is premised on consisting of a pixel of the shape of a 
dot matrix picturized with a solid state image pickup device of a veneer. Since a color 
filter of two or more element color is arranged in the shape of a mosaic by 
non-homogeneity density, a solid state image pickup device of a veneer is replaced with 
an operation so that it may become homogeneity density, but as mentioned above, a 
fake color component is generated in the case of this operation, and a color blot occurs. A 
color blot pixel detection means detects a color blot pixel which such a color blot has 
generated, and the image processing of the image-processing means is carried out so 
that a color blot may be reduced for a pixel of a predetermined range on the basis of a 
said-detected color blot pixel. 

[0009] Since existence of a color blot cannot be uniformly detected from an element color 
component about the pixel concerned in case existence of a color blot is detected about a 
certain pixel, existence of a color blot will be detected as compared with a circumference 
pixel. Moreover, although generating of a color blot originates in an element color 
component of the above falses, it can be said that it is easy to generate an element color 
component of this false about an element color component to a color filter of low density 
since a color filter of each element color is arranged by non-homogeneity density in a 
solid state image pickup device. Then, invention concerning claim 2 is considered as a 
configuration which detects the above-mentioned color blot pixel based on a change 
degree of element color reinforcement to a color filter of low density in between pixels 
which the above-mentioned color blot pixel detection means approaches mutually in an 
image processing system according to claim 1. 

[00 10] In invention concerning claim 2 constituted as mentioned above, the 
above-mentioned color blot pixel detection means detects a color blot pixel based on a 
change degree of this element color reinforcement paying attention to element color 
reinforcement to a color filter of low density between a pixel for detection, and a pixel 
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close to the pixel concerned. 

[001 1] In here, invention concerning claim 3 has considered in an image processing 
system given in above-mentioned claim 2 as an example of concrete technique which 
detects a color blot pixel as the configuration which detects the above-mentioned color 
blot pixel based on a change degree of difference of element color reinforcement of 
criteria, and element color reinforcement to a color filter of low density in between 
pixels which the above-mentioned color blot pixel detection means adjoins mutually. 
[0012] In invention concerning claim 3 constituted as mentioned above, the 
above-mentioned color blot pixel detection means detects the above-mentioned color blot 
pixel from a change degree of the difference concerned in a pixel which adjoins mutually 
paying attention to difference of element color reinforcement of criteria, and element 
color reinforcement to a color filter of low density. 

[0013] for example, the middle of drawing 23 (a) - since a color filter of low density is R 
when it turns out beforehand like a line that a color filter of R and G is arranged by 
turns -- as the element color component of criteria - G " adopting both difference - a 
change degree of deltaRG= I R-G | is investigated between adjoining pixels. Then, if a 
value of this deltaRG pays its attention to a change degree of deltaRG between pixels 
which come to show drawing 23 (f) and adjoin it, it will be set to "0.5" in a pixel near the 
boundary of a field where light hits, and a field where light does not hit, and will detect 
such a pixel as a color blot pixel. 

[0014] As the technique of detecting a color blot pixel based on a change degree of 
difference of element color reinforcement Invention concerning claim 4 as the example 
by not being caught by what was mentioned above In an image processing system 
according to claim 3, the above-mentioned color blot pixel detection means is considered 
as a configuration which detects the above-mentioned color blot pixel based on a change 
degree of difference between element color reinforcement to a color filter of low density 
in between pixels which adjoin mutually, when there are two or more color filters of low 
density. 

[0015] in invention concerning claim 4 constituted as mentioned above, two or more 
color filters of low density exist, the above-mentioned color blot pixel detection means 
asks for difference of the element color reinforcement to a color filter of low density, and 
it can set between adjoining pixels - said - a color blot pixel is detected based on a 
change degree of difference. 

[0016] That is, as mentioned above, since a fake element color component appears 
notably about an element color to a color filter of low density, it pays its attention to 
difference of element color reinforcement to a color filter of this low density. For 
example, as shown in drawing 23 (a), to the whole, density of a color filter of G is high, 
and when density of a color filter of R and B is low, a fake element color component will 
appear notably in R and B. here setting - the same - the middle - what pays its 
attention to a line - carrying out - this middle - linear interpolation of the 
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chrominance-signal level of B in each pixel of a line shall be carried out from a color 
filter of B which adjoins an upper case line side then, the middle - what shows 
chrominance-signal level of B in each pixel of a line in this drawing (d) - the same 
becoming - difference of chrominance -signal level of R and B - it is set to 
deltaRB= | R-B I =deltaRG. Therefore, in order to also show a value of deltaRB between 
adjoining pixels in this drawing (f), in a pixel near the boundary of a field where light 
hits, and a field where light does not hit, a change degree of ** deltaRB is set to "0.5", 
and detects such a pixel as a color blot pixel. 

[0017] About whether this change degree is investigated between which contiguity 
pixels, various modes can be considered irrespective of whether its attention is paid to a 
change degree of difference between element color reinforcement of whether its 
attention is paid to a change degree of difference of element color reinforcement of 
criteria, and element color reinforcement of low density, and low density. For example, 
it may be made to investigate this change degree between pixels which adjoin in the 8 of 
a horizontal direction, a perpendicular direction, and the direction of slant directions, 
and suitably, if the comparison directions are reduced, the amount of operations can be 
reduced. It is more suitable to investigate between pixels to a color filter of low density, 
when investigating the above-mentioned change degree, since it mentioned above and 
can say that a possibility that a fake element color component has occurred is high in a 
pixel to a color filter of low density. Then, invention concerning claim 5 is considered as 
a configuration which detects the above-mentioned color blot pixel based on the 
above-mentioned change degree between pixels of low density which the 
above-mentioned color blot pixel detection means adjoins mutually in an image 
processing system according to claim 2 to 4. 

[0018] In invention concerning claim 5 constituted as mentioned above, the 
above-mentioned color blot pixel detection means investigates this change degree 
between pixels corresponding to a color filter of adjoining low density, and detects a 
color blot pixel. 

[0019] On the other hand as an image processing which reduces a color blot As a 
suitable example at the time of being able to realize, if a smoothing filter of 
predetermined size is made to act on the basis of a detected color blot pixel, and 
performing such data smoothing Invention concerning claim 6 is set to an image 
processing system according to claim 1 to 5. The above-mentioned image-processing 
means Data smoothing of the color difference component which subtracted a brightness 
component from an element color component for a pixel of a predetermined range on the 
basis of the above-mentioned color blot pixel is carried out, and it has considered as a 
configuration returned to the original element color component. 

[0020] Although the above-mentioned image-processing means performs data 
smoothing for a pixel of a predetermined range on the basis of a detected color blot pixel, 
since data smoothing of a color-difference component is effective in a color blot, it carries 
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out data smoothing of the color difference component which subtracted a brightness 
component from an element color component about each pixel, and returns it to the 
original element color component after that in invention concerning claim 6 constituted 
as mentioned above. 

[0021] Moreover, since sharpness of an image may be lost by data smoothing, invention 
concerning claim 7 has been considered as a configuration in which the 
above-mentioned image-processing means carries out edge enhancement processing in 
an image processing system according to claim 6. 

[0022] In invention concerning claim 7 constituted as mentioned above, the 
above-mentioned image -processing means performs edge enhancement processing to 
image data, and sharpness lost in data smoothing is compensated with it. 
[0023] Thus, though edge enhancement processing is performed, if edge enhancement is 
carried out to a field which does not perform the above-mentioned data smoothing, since 
the idea also of edge enhancement of the outside of a field by which the said data 
smoothing is carried out also being carried out unnaturally will be carried out, 
invention concerning claim 8 has been considered for the above-mentioned 
image-processing means as a configuration to which edge enhancement processing is 
carried out to a pixel within limits which perform the above-mentioned data smoothing 
in an image processing system according to claim 7. 

[0024] In invention concerning claim 8 constituted as mentioned above, the 
above-mentioned image-processing means performs edge enhancement processing to a 
pixel within limits which perform the above-mentioned data smoothing in which 
sharpness tends to be lost. 

[0025] By the way, in performing data smoothing, in no image data, it is a best policy to 
perform data smoothing of the same range uniformly. For example, data smoothing of 
the same range should be performed to both image data with big image size, and image 
data with small image size. In this case, since the range of data smoothing in the former 
differs from a rate of occupying to an image, and a rate in the latter, even if a good 
result is obtained in the former, in the latter, the whole may fade too much. Invention 
concerning claim 9 is set to an image processing system according to claim 6 to 8. Then, 
the above-mentioned image-processing means In performing data smoothing for a pixel 
of a predetermined range on the basis of a color blot pixel by which detection was 
carried out [ above-mentioned ], when size of an image used as a processing object is 
large, a range which carries out the said data smoothing is enlarged, and when size of 
this image is small, it has considered as a configuration which makes small a range 
which carries out the said data smoothing. 

[0026] In invention concerning claim 9 constituted as mentioned above, the 
above-mentioned image -processing means detects size of image data beforehand set as 
the object of an image processing, if its size of the image data concerned is large, it will 
enlarge a range which carries out data smoothing, and if size of this image data is small, 
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it will make small a range which carries out data smoothing. Two or more smoothing 
filters with which sizes specifically differ are held, and it is realizable if it is made to use 
a smoothing filter properly according to image size. 

[0027] Moreover, invention which starts claim 10 as an example of another technique 
which reduces a color blot In an image processing system according to claim 1 to 5 the 
above-mentioned image-processing means It has considered as a configuration which 
replaces a color difference component which has a central value of a color difference 
component which subtracted a brightness component from an element color component 
for a pixel of a predetermined range on the basis of the above-mentioned color blot pixel 
by color difference component of the color blot pixel concerned, and is returned to the 
original element color component. 

[0028] The above-mentioned image-processing means detects the color* difference 
component which subtracted and obtained a brightness component from an element 
color component for a pixel of a predetermined range on the basis of a detected color blot 
pixel, transposes the color-difference component which has a central value in it to the 
color-difference component of a color blot pixel, and returns it to the original element 
color component after that in invention concerning claim 10 constituted as mentioned 
above. That is, a color blot is reduced by transposing a color difference component of a 
color blot pixel to a color difference component of a circumference pixel. In addition, 
what is necessary is just to apply a predetermined median filter etc. as a concrete 
configuration which chooses a central value of a color difference component for a pixel of 
a predetermined range. 

[0029] If the above-mentioned data smoothing is performed for a pixel of a 
predetermined range on the basis of a color blot pixel and the above-mentioned edge 
enhancement processing is performed after that, sharpness lost by data smoothing is 
suppliable. However, when a color blot pixel had occurred into a boundary partial slack 
edge portion of an image, considering an experiential standpoint, an image of the edge 
portion concerned might fade. In view of this point, invention concerning claim 11 In an 
image processing system according to claim 1 to 5 the above-mentioned 
image-processing means A color difference component which has a central value of a 
color difference component which judged whether the above-mentioned color blot pixel 
was an edge pixel, and subtracted a brightness component from an element color 
component for a pixel of a predetermined range on the basis of a same color blot pixel 
when it was an edge pixel is replaced by color difference component of the color blot 
pixel concerned. When it is not an edge pixel, data smoothing of the color difference 
component which subtracted a brightness component from an element color component 
for a pixel of a predetermined range on the basis of a same color blot pixel is carried out, 
and it has considered as a configuration returned to the original element color 
component after that. 

[0030] If a color blot pixel is detected in invention by claim 1 1 constituted as mentioned 
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above, an image-processing means will judge whether the color blot pixel concerned is 
an edge pixel. In here, when it is judged that it is an edge pixel, as it mentioned above, a 
color difference component for a pixel of a predetermined range on the basis of a color 
blot pixel is detected, a color difference component which has a central value in it is 
transposed to a color difference component of a color blot pixel, and it returns to the 
original element color component after that. On the other hand, when it is judged that it 
is not an edge pixel, as it mentioned above, data smoothing of the color difference 
component of a pixel of a predetermined range on the basis of a color blot pixel is carried 
out, and it returns to the original element color component after that. 
[0031] For example, since a color difference component which is the color blot pixel 
concerned replaces a color difference component which is a circumference pixel and 
serves as a pixel of white or black purely when a color blot pixel has occurred into 
boundary portions of white and black, although a color blot is canceled, a boundary 
portion does not fade. Moreover, what is necessary is to compare a change degree of this 
color difference component with a predetermined threshold, and just to carry out 
judging it as an edge pixel etc., when the change degree of a same color difference 
component is larger since a change degree of a color difference component becomes large 
between contiguity pixels in an edge pixel, if it hits judging whether it is an edge pixel. 
Of course, an edge pixel is regarded as a large pixel of brightness inclination, and you 
may make it judge an edge pixel based on a change degree of a brightness component 
between contiguity pixels. 

[0032] The technique of detecting a color blot pixel and reducing a color blot about a 
pixel of a predetermined range on the basis of the color blot pixel concerned Invention 
concerning claim 12 as the example by necessarily not being restricted to equipment 
with substance It is the image -processing method which carries out an image processing 
to image data which consists of a pixel of the shape of a dot matrix filled up and 
generated by operation so that it might become homogeneity density, while a color filter 
of two or more element color was picturized with a solid state image pickup device of a 
veneer arranged in the shape of a mosaic by non-homogeneity density. A color blot pixel 
is detected in this image data, and in targetting a pixel of a predetermined range on the 
basis of a color blot pixel for an image processing, in order to reduce a color blot, it has 
considered as a configuration which performs this image processing on the basis of a 
color blot pixel by which detection was carried out [ above-mentioned ]. 
[0033] That is, there is no difference not only in equipment which not necessarily has 
substance but in being effective as the method. 

[0034] By the way, an image processing system which detects a color blot pixel and 
reduces a color blot about a pixel of a predetermined range on the basis of the color blot 
pixel concerned as mentioned above contains various kinds of modes as thought of that 
it may be used in the condition of existing independently and having been included in a 
certain device, and invention. Moreover, it can realize by hardware or can change [ that 
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[0035] When becoming the software which controls an image processing system as an 
example of embodiment of thought of invention, naturally it exists on a record medium 
which recorded this software, and it must be said that it is used. As the example, 
invention concerning claim 13 While a color filter of two or more element color is 
picturized with a solid state image pickup device of a veneer arranged in the shape of a 
mosaic by non -homogeneity density It is data medium which recorded an 
image-processing control program for an image processing system which carries out an 
image processing to image data which consists of a pixel of the shape of a dot matrix 
filled up and generated by operation so that it might become homogeneity density. A 
color blot pixel is detected in this image data, and in targetting a pixel of a 
predetermined range on the basis of a color blot pixel for an image processing, in order 
to reduce a color blot, it has considered as a configuration which performs this image 
processing on the basis of a color blot pixel by which detection was carried out 
[ above-mentioned ]. 

[0036] of course, the record medium may be magnetic-recording data medium, may be 
magneto-optic-recording data medium, and can completely be considered the same way 
in any record media developed from now on. Moreover, about duplicate phases, such as 
a primary replica and a secondary replica, it is equivalent without room to completely 
ask. In addition, it is the same even if it seems that there is no change in this invention 
being used, and it was written in a semiconductor chip even when carrying out as the 
supply method using a communication line. 

[0037] Furthermore, a part is software, when a part is realized by hardware, there is 
nothing that is completely different in thought of invention, and it may be made into a 
thing of a gestalt which memorizes a part on a record medium and is read suitably if 
needed. 
[0038] 

[Effect of the Invention] As explained above, since this invention detects a color blot 
pixel and the color blot was reduced for the pixel of the predetermined range on the 
basis of the color blot pixel concerned, it can offer the image processing system which 
the amount of operations is reduced and can shorten the processing time in the image 
data picturized with the veneer-type solid state image pickup device. 
[0039] Moreover, according to invention concerning claim 2, since what is necessary is 
just to pay its attention to the element color reinforcement to the color filter of low 
density, a color blot pixel is easily detectable. 

[0040] Furthermore, according to invention concerning claim 3, since what is necessary 
is just to investigate the change degree of the difference of the element color 
reinforcement of criteria, and the element color reinforcement to the color filter of low 
density, the detection operation of a color blot pixel can be performed easily. 
[0041] Furthermore, since what is necessary is according to invention concerning claim 
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4 just to pay its attention to the change degree of the difference between the element 
color reinforcement to the color filter of low density uniformly when there are two or 
more color filters of low density, the detection operation of a color blot pixel can be 
performed easily. 

[0042] furthermore, between pixels [ as opposed to / according to invention concerning 
claim 5 / the color filter of low density ] - the above - since the change degree of 
difference was investigated, more reliable detection can be performed. 
[0043] Furthermore, since what is necessary is according to invention concerning claim 
6 in reducing a color blot by data smoothing to carry out data smoothing of the color 
difference component, and just to return to the original element color component, it can 
calculate easily. 

[0044] Furthermore, according to invention concerning claim 7, in order to perform edge 
enhancement processing, lowering of the sharpness of the image by data smoothing is 
supp liable. 

[0045] Furthermore, in order to perform edge enhancement processing to the pixel 
within the limits which perform data smoothing according to invention concerning 
claim 8, sharpness does not increase unnaturally about the pixel of data smoothing out 
of range. 

[0046] Furthermore, since it was made to change the range which carries out data 
smoothing according to the size of the image used as a processing object according to 
invention concerning claim 9, data smoothing of the optimal range can be performed. 
[0047] Furthermore, according to invention concerning claim 10, since the central value 
was used for the color blot pixel of the color difference component of the pixel of a 
predetermined range, a color blot can be reduced. 

[0048] Furthermore, when it is not an edge pixel, in order according to invention 
concerning claim 1 1 to have used the central value for the color blot pixel of the color 
difference component of the pixel of a predetermined range when a color blot pixel was 
an edge pixel, and to perform data smoothing, the edge portion of an image does not 
fade. 

[0049] Furthermore, according to invention concerning claim 12, the image-processing 
method which the amount of operations is reduced similarly and can shorten the 
processing time can be offered, and data medium which recorded the image-processing 
control program can be offered according to invention concerning claim 13. 
[0050] 

[Embodiment of the Invention] Hereafter, the operation gestalt of this invention is 
explained based on a drawing. Drawing 1 shows the image processing system which 
applied the image processing system concerning 1 operation gestalt of this invention 
with the block diagram, and drawing 2 shows the example of a concrete hardware 
configuration with the outline block diagram. In drawing 1 , a picture input device 10 
outputs the real image picturized using CCD of a veneer type to an image processing 
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system 20 as image data expressed with the dot- matrix-like pixel. A color blot occurs in 
the image data picturized in CCD of a veneer type from the principle mentioned above, 
the image processing of the image processing system 20 is carried out to it so that a 
color blot pixel may be detected in input image data and a color blot may be reduced in 
the predetermined range on the basis of the color blot pixel concerned, and it outputs to 
the image output unit 30, and the image output unit 30 outputs the image data by 
which the image processing was carried out by the dot-matrix-like pixel. 
[0051] It can be said that it is equipped with the color blot pixel detection means since 
an image processing system 20 detects a color blot pixel, and it is equipped also with an 
image-processing means since it performs an image processing so that a color blot may 
be reduced on the basis of the detected color blot concerned. 

[0052] A film scanner 11, a digital still camera 12 or a video camera 14 etc. with which 
the example of a picture input device 10 was equipped with CCD of the veneer type in 
drawing 2 corresponds. For example, drawing 3 shows the easy example of a hardware 
configuration of this digital still camera 12 with the outline block diagram. In this 
drawing, incident light is received by CCD 12b through optical-system 12a. The color 
filter of R, G, and B each color is arranged at a predetermined rate corresponding to 
each pixel, and, as for this CCD 12b, the chrominance signal in each pixel is outputted in 
actuation circuit 12c. Digital conversion of the outputted chrominance signal is carried 
out, it is inputted into 12d of interpolation arithmetic circuits, acquires the chrominance 
signal about the element color component which cannot be directly obtained in each 
pixel at the 12d of the interpolation arithmetic circuits concerned by the linear 
interpolation operation from a surrounding pixel, and saves it as gradation data of RGB 
at image memory 12e. 

[0053] On the other hand, the computer system which the example of an image 
processing system 20 becomes from a computer 21, a hard disk 22, a keyboard 23, 
CD-ROM drive 24, a floppy disk drive 25, a modem 26, etc. corresponds, and, as for the 
example of the image output unit 30, a printer 31 and display 32 grade correspond. In 
addition, it can connect with a public communication channel about a modem 26, and 
can connect with an external network through this public communication channel, 
software and data can be downloaded, and it can introduce. 

[0054] In this operation gestalt, while the film scanner 11 and digital still camera 12 as 
a picture input device 10 output the gradation data of RGB as image data, the printer 
31 as an image output unit 30 needs as an input the binary data of CMYK which added 
black to CMY (cyanogen, MAZENDA, yellow) or this as gradation data, and a display 32 
needs the gradation data of RGB as an input. 

[0055] On the other hand, within the computer 21, operating system 21a is working and 
printer driver 21b and display driver 21c corresponding to a printer 31 or a display 32 
are incorporated. Moreover, image-processing application 2 Id, activation of processing 
is controlled by operating system 21a, it cooperates with printer driver 21b or display 
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driver 21c if needed, and a predetermined image processing is performed. Therefore, 
while the concrete role of this computer 21 as an image processing system 20 inputs the 
gradation data of RGB, it creates the gradation data of RGB which performed the image 
processing so that a color blot pixel may be detected and a color blot may be reduced, 
and making it display it on a display 32 through display driver 21c, it is changed into 
the binary data of CMY (or CMYK) through printer driver 21b, and a printer 31 is made 
to print it. 

[0056] Thus, although a computer system is incorporated between the I/O devices of an 
image and it is made to perform an image processing in this operation gestalt, this 
computer system is not necessarily needed and it can apply to the system which 
performs an image processing so that a color blot may be reduced to the image data 
which the interpolation operation was carried out and the color blot generated as it 
mentioned above, while being picturized in CCD of a veneer type. For example, you may 
be the system which is made to display on display 32a, or printer 31a is made to print 
using the image data which incorporated the image processing system which carries out 
an image processing similarly in digital still camera 13a equipped with CCD of a veneer 
type as shown in drawing 4 , and reduced the color blot. Moreover, as shown in drawing 
5 , in printer 31b which inputs and prints image data through a computer system, it is 
also possible to constitute so that the image processing of the color blot may be reduced 
and carried out to the image data inputted through film scanner lib, digital still 
camera 13b, etc. which have CCD of a veneer type. 

[0057] The image processing which reduces detection and a color blot of the color blot 
pixel mentioned above is specifically performed by the image-processing program 
corresponding to the flow chart shown in drawing 6 etc. within the above-mentioned 
computer 21. Although the reduction method of the color blot adopted in this operation 
gestalt is the same as usual about the point performed by making a smoothing filter etc. 
act so that it may mention later, the field on which this smoothing filter etc. is made to 
act differs from the former by being restricted around a color blot pixel. About the image 
data used as a processing object, as shown in drawing 7 (a) and (b), the bit map of two 
kinds of image sizes is considered, and the smoothing filter of the same size shown to 
both in the shadow area in drawing is made to act here. If each pixel of image data and 
each pixel of CCD correspond that image sizes differ by one to one, naturally according 
to the number of pixels of CCD to be used, image sizes also differ, but even if it is the 
case where CCD of the number of the same pixels is used, it shall expand and contract 
suitably, image size shall be changed, and, also in this case, it shall contain. 
[0058] If image sizes differ in the limitation which has applied the smoothing filter of 
the same size so that clearly also from drawing, the rates that the field by which data 
smoothing is carried out occupies to the whole image also differ. Therefore, if data 
smoothing of the field of suitable magnitude may be carried out as shown in drawing 7 
(a) when the smoothing filter of the same size is made to act uniformly to the image data 
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of all image sizes, the rate that the field by which data smoothing is carried out as 
shown in this drawing (b) occupies to the whole image may become large. Since carrying 
out data smoothing is exactly blurring an image, most images may fade in what is 
shown in this drawing (b). 

[0059] Then, he holds 3x3 [ as ] shown in drawing 8 , 5x5, and the smoothing filter of 
size with which the plurality of 7x7 pixels differs, and is trying to use these smoothing 
filters properly suitably in this operation gestalt according to image size. Here, in 
judging the image size of a bitmapped image, (height)x(width) of an image is computed 
and it asks for the number of pixels, and although it is good also considering this 
computed number of pixels as an index, the image size of a processing-object image is 
judged according to A expressed with a degree type in this operation gestalt. 
[0060] 

A=min (height, width) - (l) 

here - setting - min (height, width) - height or width - the smaller one is meant. And 
at step Si 10, if it becomes A<300 and 3x3 pixel will become smoothing filter 300 
<=A<=600, the class of 5x5-pixel smoothing filter which it will branch and will be used 
at step S122 - step S126 like a 7x7-pixel smoothing filter, respectively if it becomes 
smoothing filter A>600 is saved in a work area. A work area may be RAM in a computer 
21, and may be a hard disk 22. 

[0061] Being based on min (height, width) here is based on the following reasons. What 
is necessary is just to judge at a rate of the number of pixels by which data smoothing is 
essentially carried out to the total number of pixels in judging whether the size of a 
smoothing filter is suitable. However, for example, even if it is the image data of the 
number of the same pixels, there is a broad image like the bitmapped image shown in 
drawing 9 (a), and compared with the height direction, there is a standard image with 
the crosswise length long a little like the bitmapped image shown in this drawing (b). If 
the smoothing filter used according to the total number of pixels of a processing-object 
image shall be determined, the same smoothing filter will be chosen in both. Then, even 
if the size of this smoothing filter is suitable in the latter, the impression which the 
height direction may be mostly graduated covering an overall length in the former, and 
faded visually in such a case is received. Therefore, criteria, then such evil are [ any of 
height and width, or the smaller one ] avoidable. 

[0062] If the flow chart of drawing 6 is referred to, carry out vertical scanning 
perpendicularly, and it is made to move to it, carrying out horizontal scanning of the 
processing-object pixel horizontally about the image data which consists of a 
dot* matrix-like pixel, as shown in drawing 10 , and judges whether it is a color blot pixel 
about each pixel. 

[0063] When image data consists of dot-matrix-like pixels, it is expressed by the 
gradation data ("0" - "255") of RGB for every pixel, if the class of smoothing filter used at 
step S122 - step S126 is saved in a work area - a degree - the difference of the 
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gradation data [ in / on step Si 30 and / an object pixel and its circumference pixel ] of R 
and B - deltaRB is computed. This deltaRB deltaRB= | RB I - (2) 
It is expressed. 

[0064] As CCD in this operation gestalt is shown in drawing 23 (a), while the color filter 
of each color of R, G, and B is arranged in the shape of a mosaic corresponding to each 
pixel, only the color filter of G is arranged alternately, density is high, and the color 
filter of R and B serves as low density. And the linear interpolation operation of the 
chrominance signal which cannot be directly acquired in each pixel was carried out from 
the chrominance signal of the adjoining pixel, the chrominance signal of R, G, and B all 
color was acquired, and it has changed into gradation data. Therefore, if it carries out 
from probability, it can be said that a color blot occurs by the element color component 
of a false - original reinforcement is not obtained about R of low density, and the 
gradation data of B, or the color component which originally does not have the need 
occurs in a certain pixel - as a result of a interpolation operation. 

[0065] Moreover, it is known that a color blot will appear notably near the boundary 
between white and black especially. For example, when expressing white in the pixel 
corresponding to the color filter of R, the gradation data of original RGB becomes = 
(255,255,127) as a result of a interpolation operation (R, G, B) the place used as = (R, G, 
B) (255,255,255). In here, since the color filter of G is high-density, its probability for a 
fake element color component to occur by the interpolation operation about G 
component is small, and since it can obtain another side and the component of R from a 
color filter directly, a fake color component does not generate it. Although deltaRB is set 
to "0", and deltaRB should be set to "0" also when expressing black if white is essentially 
expressed in a certain pixel, the inclination for the value of deltaRB to become large 
compared with this in a color blot pixel is shown. 

[0066] Of course, depending on image data, from the first, the component of R and G is 
high and, naturally a pixel with the low component of B may also exist. However, in 
such a case, each element color component is held also in a contiguity pixel, and the 
value of deltaRB changes gently-sloping in many cases as it keeps away from the pixel 
concerned. On the other hand, it can be said that as for the color blot the change degree 
of deltaRB has not necessarily made a mistake in a large pixel as a color blot pixel 
between contiguity pixels since either of the pixels which adjoin mutually is pixels, such 
as white or black, generating per pixel theoretically. Then, in this operation gestalt, as 
it mentions later, the value-change degree of deltaRB is investigated between a 
processing-object pixel and a circumference pixel, and this change degree detects a large 
pixel as a color blot pixel. Of course, since the color filter of G is high-density and it can 
say that a possibility that a fake element color component will occur by the interpolation 
operation is low, they are (2) types on the basis of this element color component. 
deltaGR= I G-R I - (3) 
deltaGB=|G-B| - (4) 
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It is also possible to substitute the formula to say. 

[0067] Moreover, it is more suitable to compare between the pixels corresponding to the 
color filter of low density, if it hits to investigate the change degree of such deltaRB. 
That is, the direction with which the direction of the pixel corresponding to the color 
filter of low density compared with the pixel corresponding to the color filter of high 
density compares the change degree of deltaRB between the pixels corresponding to the 
color filter of low density since it is easy to generate a fake element color component can 
perform more reliable detection. 

[0068] Detection of a actual color blot pixel is performed at step S140, and it judges that 
it is a color blot pixel at this step S140 from the change degree between the 
circumference pixels of deltaRB computed as mentioned above. As shown in drawing 11 , 
while centering on a processing-object pixel at this time, the matrix which made it x 
horizontally and made it y perpendicularly is considered. E=4deltaRB(x y)*2deltaRB 
(x-l,y-l) 

-2DeltaRB (X+lJ-l) - (5) 

It comes out and the size relation between the value of E expressed and predetermined 
threshold Th is compared. And in E>=Th, it is judged that it is a color blot pixel. 
Therefore, in step S130 mentioned above, while calculating deltaRB (x y) in the pixel for 
a judgment, delta RB (x~l, y-l) and delta RB (x+1, y-l) will be calculated as a value of 
deltaRB of a circumference pixel. 

[0069] The semantics which detects a color blot pixel in accordance with the criterion of 
E>=Th is as follows. If the color blot has occurred in a processing-object pixel, since 
deltaRB value-change degree between a pixel and its circumference pixel concerned 
becomes large, when the value of E also becomes it large to refer to (5) types and 
predetermined threshold Th is exceeded, it will be judged as a color blot pixel. Moreover, 
when (5) types and drawing 1 1 are referred to, it turns out easily that the change degree 
of deltaRB is investigated by the pixel for a judgment, and the pixel of the direction of 
slant. Here, if the pixel of the direction of slant corresponds to R if the pixel of the 
direction of slant corresponds to B if drawing 23 (a) is referred to and the pixel for a 
judgment corresponds to R, and the pixel for a judgment corresponds to B, and the pixel 
for a judgment corresponds to G, the pixel of the direction of slant corresponds to G. 
That is, when deltaRB value-change degree is investigated between the pixels 
corresponding to the element color of the low density which adjoins when the pixel for a 
judgment corresponds to the element color of low density and the pixel for a judgment 
corresponds to the element color of high density, the change degree of deltaRB will be 
investigated between the pixels corresponding to the element color of the adjoining high 
density. 

[0070] Therefore, in between the pixels which adjoin mutually at steps S130 and S140, 
the color blot pixel will be detected based on the change degree of the difference between 
the element color reinforcement to the color filter of low density, and the hardware 
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configuration and software which perform these will constitute a color blot pixel 
detection means. 

[0071] When it is judged as what is a color blot pixel at step S140, the pixel concerned 
judges whether it is an edge pixel at step S150. If it hits judging whether it is an edge 
pixel, since the technique performed based on a color difference component is effective, 
in this operation gestalt, the brightness component Y is subtracted from the gradation 
data of R and B, and it asks for the color difference components CI and C2, respectively. 
In addition, these color difference components Cl and C2 Cl=R-Y (6) 
C2=B-Y"(7) 
It can express. 

[0072] However, although it is also possible to Luv color specification space to carry out 
color conversion in order for the gradation data of RGB not to have the value of 
brightness directly but to ask for brightness, it is not a best policy from problems, such 
as the amount of operations. For this reason, the transformation of the degree type 
which asks for brightness soon from RGB which is used in the case of television etc. is 
used. 

Y=0.30R+0.59G+0.11B - (8) 

[0073] Since an edge pixel is the boundary portion of an image and it can be said for the 
change degree of the color difference components Cl and C2 to be large between the 
adjoining pixels, when satisfying either among the following two criteria, it can be 
judged as an edge pixel. 
I Cl(xy)-Cl(x-l,y-l) |>=Thl--(9) 
I C2(x y)-C2(x-l, y-1) I >=Th2 (10) 

In addition, x in here shows the horizontal coordinate and y shows the vertical 
coordinate. 

[0074] That is, the place which (9) and (10) types mean is exactly having judged whether 
it asking for the change degree of the color difference components Cl and C2, and there 
being two or more thresholds Thl and Th between the pixels of the adjoining direction 
of slant, respectively in the image data which consists of a pixel of the shape of a dot 
matrix centering on the color blot pixel concerned, as shown in drawing 12 . And when 
satisfying one of decision criteria, it will be judged as the edge pixel. Of course, 
essentially, the pixel is arranged in the shape of a grid in all directions, as shown in 
drawing 13 , and when a central pixel is observed, there are eight contiguity pixels. 
Therefore, while asking for the change degree of the color difference components Cl and 
C2 similarly between each adjoining pixel, a comparison operation is carried out among 
thresholds Thl and Th2, respectively, and, in a certain case, the change degree of the 
color difference components Cl or C2 should just judge it as a color blot pixel two or 
more thresholds Thl or Th in any one comparison operation. 

[0075] Thus, if it is in judging whether a color blot pixel is an edge pixel, although the 
technique performed based on the change degree of the color difference components Cl 
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and C2 is effective, in order to have to perform the comparison operation about the color 
difference components CI and C2 in 8-pixel adjoining each about one color blot pixel, 
the amount of operations becomes great and processing speed may fall. Then, a 
comparison operation is performed about 4 pixels of the direction in every direction, or 
as shown in drawing 14 , as shown in drawing 15 , it is made to perform a comparison 
operation about 4 pixels of the direction of slant, and you may make it reduce the 
amount of operations. 

[0076] Moreover, what is necessary is to make it judge whether it is an edge pixel by the 
size of brightness inclination, and just to substitute a degree type for (9) and (10) types 
which were mentioned above in this case. 
I Y(xy)-Y(x-1, y-1) | >=Th3 - (ll) 

If this (ll) type is used as a decision criterion of an edge pixel, the amount of operations 
being reduced by half compared with the case (9) and (10) types being used will be 
understanding easily. 

[0077] When it is judged as that whose color blot pixel concerned is not an edge pixel at 
step S150, the smoothing filter determined at step S122 - step S126 to the same color 
blot pixel by step S152 is made to act, and data smoothing is performed to the pixel of 
the predetermined range on the basis of a same color blot pixel. Of course, if it hits 
performing data smoothing, since smoothing of a color difference component is effective, 
data smoothing is performed to the color difference components Cl and C2 computed 
based on the above (6) and (7) types in this operation gestalt. 

[0078] Here, data smoothing using a smoothing filter is explained. It is used for making 
a central numeric value into weighting of the color difference components Cl and C2 of 
the processing-object pixel in matrix-like image data, carrying out weighting 
corresponding to the numeric value in the grid of this smoothing filter to the 
circumference pixel, and integrating in each smoothing filter shown in drawing 8 . In 
this case, since "1" is stood to all grids, color difference component Cl ? after smooth 
totals the color difference component Cl of each grid, and with the total number of grids, 
it does a division, it asks for it, and color difference component C2' after smooth is called 
for similarly. Of course, you may make it give weighting suitably to each grid, however, 
since it is performing a matrix operation which obtains, is and mentioned things above 
when a smoothing filter is made to act, if weighting is given to each grid, the amount of 
operations will also increase. That is, in this operation gestalt, although what is 
necessary is to total the data of each pixel and just to do a division with the number of 
grids, since "1" is stood to each grid of a smoothing filter, when weighting is made by 
each grid, it becomes great [ the number of grids / the amount of operations ], since 
multiply operation and an add operation are needed. 

[0079] When such a matrix operation is performed for all the pixels of image data like 
before, the amount of operations may become huge and the great processing time may 
start. Therefore, if a color blot pixel is detected like this operation gestalt and it is made 
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to perform data smoothing about the circumference of the color blot pixel concerned, the 
cutback of the large amount of operations will be expected and it will become realizable 
about a high-speed image processing. 

[0080] On the other hand, when it is judged at step S150 that the color blot pixel 
concerned is an edge pixel, a 5x5-pixel median filter is made to act focusing on a same 
color blot pixel at step S154. In addition, the size of the median filter applied actually 
does not necessarily need to be 5x5 pixels, and applying a 3x3-pixel median filter etc. 
can change it suitably. Then, the case of explanation where a 3x3-pixel median filter is 
applied is explained for convenience. 

[0081] For example, as shown in drawing 16 , the 3x3-pixel dot matrix centering on a 
color blot pixel is taken into consideration. In addition, the value of each grid shows the 
value of the color difference component Cl, and the slanting line in drawing corresponds 
in the direction of an edge. Here, applying a 3x3*pixel median filter means sorting the 
value of a total of the 9-pixel color difference component Cl in ascending order or 
descending order, choosing a central value, and replacing with the color difference 
component Cl of a color blot pixel. That is, since 6 pixels of pixels of "10" exist [ the 
value of the color difference component Cl ], 1 pixel of pixels of "40" exists and 3 pixels 
of pixels of "100" exist, what is shown in this drawing comes to be shown in drawing 17 , 
if these values should be sorted in ascending order. Then, a central value is set to "10" so 
that clearly also from this drawing, and the color difference component Cl of the color 
blot pixel concerned is set to "10." 

[0082] On the other hand, if the 3x3-pixel smoothing filter was made to act in here, "33" 
which is the value which did the division of the grid total value "300" with the number 
of pixels "9" will become color difference component Cl* after data smoothing. Since 
color difference component CT after this data smoothing equalizes and adds the color 
difference component Cl of a circumference pixel to a color blot pixel, it will consider as 
smooth image data. Thus, although what was smoothed has the same semantic **** as 
that over which the so-called low pass filter was covered, an image is smoothed and a 
color blot stops being conspicuous, since it becomes the impression to which the edge 
portion also faded, it is not a best policy. Then, it is clear also from the above-mentioned 
result of an operation that an edge portion will not fade if the median filter mentioned 
above to the edge pixel is applied. 

[0083] On the other hand, when drawing 16 is referred to, it turns out that the color blot 
has occurred [ the value of the color difference component Cl ] in the pixel of "40." Then, 
since the value of a 7-pixel color difference component is "100" in adjoining 8 pixels and 
1 pixel of values of a color difference component is "10" when a 3x3-pixel median filter is 
applied to this color blot pixel, it turns out that the value of the color difference 
component of the color blot pixel concerned will also replace "100", and a color blot is 
reduced. Thus, the median filter also has the effect of reducing a color blot, making it 
not blur an edge portion, and the semantics which judges whether the color blot pixel 
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concerned is an edge pixel at the above-mentioned step S150 is based on this reason. 
[0084] In addition, although the median filter illustrated here is 3x3 pixels, of course, in 
the case of the 5x5-pixel median filter adopted with this operation gestalt, it can think 
completely like the case of 3x3 pixels that what is necessary is just to choose a central 
value in a total of 25 pixels. Moreover, although illustrated about the color difference 
component Cl, it cannot be overemphasized that the same is said of the color difference 
component C2. 

[0085] By the way, it is more suitable also from processing speed to suppress the scene 
which applies a median filter as much as possible, since the median filter is 
comparatively later if the operation speed of a smoothing filter and a median filter is 
measured. If this formula may be satisfied by either of the color difference components 
Cl and C2 when adopting (9) and (10) types as a decision criterion of an edge pixel, this 
formula can be satisfied on the both sides of the color difference components Cl and C2. 
Here, since there is nothing and lowering of processing speed is caused, the need of 
applying a median filter about both color difference components in the case of the 
former applies a median filter at step S154 only in the color difference component which 
satisfies this formula, while is another, and if a smoothing filter is applied at step S152 
about a color difference component, it can raise processing speed as a whole. Of course, 
since it cannot judge whether the change degree of which color difference component is 
large when adopting (ll) types as a decision criterion of an edge pixel, a median filter 
will be applied to the both sides of the color difference components Cl and C2 at step 
S 154 in this case. 

[0086] As mentioned above, reducing a color blot is exactly smoothing an image, and it 
not being conspicuous and carrying out a color blot, but it can also assume becoming the 
impression to which the portion faded, then, this operation gestalt - setting - a degree 
- edge enhancement processing is performed at step S160. 

[0087] For this edge enhancement processing, brightness Y 1 after emphasis is Y— Y+ 
(Y-Yunsharp) to the brightness Y of each pixel before emphasis. - (12) 
It calculates by carrying out. Here, it is Yunsharp. Unsharp mask processing is 
performed to the image data of a color blot pixel, and unsharp mask processing is 
explained below. In this operation gestalt, as shown in drawing 18 , it has 3x3, 5x5, and 
three kinds of unsharp masks that consist of 7x7 pixels, and the size of the smoothing 
filter determined at steps S122-S126, respectively is supported. For example, when 
choosing a 3x3-pixel smoothing filter, a 3x3-pixel unsharp mask will be chosen. It is 
used for making a central numeric value into weighting of Y (x y) in each pixel, carrying 
out weighting corresponding to the numeric value in the grid of this mask to the 
circumference pixel like the smoothing filter which also mentioned these unsharp 
masks above, and integrating. For example, it is [0088] when using a 3x3-pixel unsharp 
mask. 

[Equation l] 
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It integrates based on the becoming operation expression. In this (13) type, "136" is the 
total value of a weighting coefficient and it becomes grid total value in the smoothing 
filter with which sizes differ, respectively. That is, if it is 5x5 pixels, it will be set to 
"400", and it will be set to "900" if it is 7x7 pixels. Moreover, Mij is a weighting 
coefficient indicated by the grid of an unsharp mask, and Y (x y) is a brightness 
component in each pixel. Furthermore, the coordinate value of a horizontal train and a 
column shows ij to the unsharp mask. 

[0089] Since Yunsharp (x y) makes weighting of a circumference pixel low and adds it to 
a color blot pixel, it has the same semantic **** as that over which the low pass filter 
was similarly covered also in this case. Therefore, it has the same semantic **** as that 
over which it means that had lengthened the low-frequency component from all original 
components, and the high-pass filter was covered with "Y(x y)-Yunsharp" (x y). And if 
this high frequency component that passed the high-pass filter is added to "Y (x y)", it 
will mean increasing a high frequency component, and a result as which an edge is 
emphasized is brought, and the sharpness of an image improves. 

[0090] in addition, these unsharp masks are clear also from drawing 18 - as -- a center 
section ■■ most " the injury with weight the weighting coefficient is small gradually as 
it is large and goes to a periphery. Therefore, it can be said that the effect which the 
weighting coefficient by the side of a periphery has on grid total value is slight. On the 
other hand, the idea also of the matrix operation shown by (13) formulas etc. also 
becoming great [ the amount of operations ], since only the number of grids of the 
unsharp mask adopted to the pixel around a processing-object pixel is [ multiply 
operation and an add operation ] needed is carried out. Then, he reduces the amount of 
operations and is trying to raise processing speed in this operation gestalt by using 3x3, 
5x5, and the 7x7-pixel unsharp mask which excluded and constituted the weighting 
coefficient by the side of a periphery beforehand. 

[0091] By the way, in this operation gestalt, although size of a smoothing filter and size 
of an unsharp mask are made the same, this is based on the following reasons. For 
example, data smoothing should be performed to the bitmapped image shown by 
drawing 19 to the field shown in the shadow area in drawing, unsharp mask processing 
should be performed to the field shown by part for a drawing medium wave line part, 
and brightness should be emphasized. Since the semantics which emphasizes that 
brightness mentioned above compensates the sharpness which data smoothing was 
carried out and was lost, if brightness is emphasized to the outside of a smoothing field, 
that sharpness improves unnaturally in the field of this outside may generate it. For 
this reason, although the smoothing filter and the unsharp mask are made into the 
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same size with this operation gestalt, you may make it the latter size become small of 
course compared with the former. 

[0092] a step - S - 160 - **** - being above edge enhancement processing ■■ 
carrying out •■ while ■■ emphasis the back - brightness - Y - ' - processing " the back 

- the color difference " a component -- using - while - (- six --) - (•■ eight --) - a formula 
-- being based - R - 1 - G ' B - * " gradation *■ data - obtaining . That is, while 
reducing a color blot at steps S152 and S154, gradation data will be generated at step 
S160, and the hardware configuration and software which perform these will constitute 
an image-processing means. 

[0093] in addition - a step - S " 160 " setting - having emphasized - brightness " Y " ' 

- using it " things " from — R " ' - G — ' - B - ' - gradation - data -- negative " a value 

- becoming - **** "-- 255 " " - exceeding - as " a value -- becoming " things - it is . 
However, as gradation width of face, since it is the range of "0" - "255", negative 
gradation data is uniformly set to "0", and the gradation data exceeding "255" is 
uniformly set to "255." And a processing-object pixel is moved at the following step S170, 
and the same processing is repeated until it judges that it ended about all pixels at step 
S180. 

[0094] By the way, if a smoothing filter is applied focusing on a color blot pixel and edge 
enhancement processing is performed after that, a color blot will be reduced by data 
smoothing and the sharpness of the image lost in data smoothing by edge enhancement 
processing will be compensated. Therefore, it cannot ask whether a color blot pixel is an 
edge pixel essentially, but an effect can be acquired also as such a configuration that 
what is necessary is just to perform this processing uniformly to all color blot pixels. 
However, in this configuration, since the edge portion might fade from the experiential 
standpoint, when a color blot pixel was an edge pixel, the result with the good place 
which applied the median filter was able to be obtained. 

[0095] Here, it explains, illustrating the simulation model of an easy single dimension 
about the effect of data smoothing of this operation gestalt, and edge enhancement 
processing. Drawing 20 is the table showing the value of various kinds of parameters in 
the single dimension simulation model when not performing edge enhancement 
processing. In this drawing, the left end matrix of R, G, and B shows the color filter 
array of CCD. If light has hit if it "1 (gradation data is 255) 1" Comes to show the 
incidence condition of light, i.e., "IN" shown in the right-hand of this matrix "0 
(gradation data is 0) 0" Comes to mean "white", it means "black." And in each pixel of 
CCD, the chrominance signal which cannot be acquired directly shall have been 
acquired from the chrominance signal of the adjoining pixel by the linear interpolation 
operation. 

[0096] Here, although a 2-dimensional array should consider essentially, its attention is 
paid to the central column of the matrix of Above R, G, and B in order to simplify 
explanation. In this semantics, it is called the simulation model of a single dimension. 
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Then, the pixel which the fake chrominance signal generated like G(B) =0.5 and R= 0.5 
near the boundary of white and black from the principle mentioned above, respectively, 
and the chrominance signal of this false generated is detected as a color blot pixel. If a 
color blot pixel is detected, according to (6) - (8) type, the color difference components Cl 
and C2 will be computed, data smoothing of these color difference components Cl and 
C2 will be carried out, and color difference component Cl' and C2' will be obtained. In 
addition, "1, 1, 1, 1, 1, 1, 1" are applied as a smoothing filter of a single dimension here. 
That is, each pixel value of 3 pixels is totaled around a processing-object pixel, and a 
division is done by "7." and - obtaining - having had " a color-difference signal C *• 
one ' -- C " two ' - (-- six --) - ■(" eight --) -- a formula - being based - origin - a 
chrominance signal - returning - data smoothing - the back R - ' - G - 9 ~ B •• 1 - 
obtaining - having . clear also from drawing - as - the pixel near the boundary of white 
and black - it can set (R\ G', and B - ') - respectively (61 0. 75 0. 0.61) - (-- it turns out 
that it became 0.25, 0.11, and 0.11), the original value of "IN" was approached, and the 
color blot was reduced. 

[0097] Moreover, drawing 21 shows similarly the single dimension simulation model at 
the time of performing edge enhancement processing using the unsharp mask of the 
same size as a smoothing filter while performing data smoothing. Although there are no 
thing and difference which mentioned above performing data smoothing in quest of the 
color difference components Cl and C2 also in this case, in case it returns to the original 
chrominance signal using (6) - (8) type, luminance - signal Y' which carried out emphasis 
processing using the unsharp mask of the single dimension which gave weighting of "1, 
6, 18, 25, 18, 6, 1" is used, then, the pixel near the boundary of white and black - it can 
set (R\ G\ and B - 0 - it becomes respectively (67 0. 81 0. 0.67) with (0.10, -0.04, -0.04). 
of course - since the value which can be taken as a signal value of RGB is "0" - "1" - 
since - it turns out actually that the latter data was set to 0.10, and (0, 0), and the color 
blot was further canceled compared with what is shown in drawing 20 . 
[0098] Furthermore, drawing 22 shows similarly the single dimension simulation model 
at the time of performing edge enhancement processing using the unsharp mask of size 
smaller than a smoothing filter. In this case, the unsharp mask of 5 figures smaller than 
the size (7 figures) of a smoothing filter called "1, 11, 25, 11, 1" of a single dimension is 
used, and -- if it calculates like what was mentioned above - the pixel near the 
boundary of white and black - it can set (R\ G\ and B - 0 ■- it becomes respectively (65 
0. 79 0. 0.65) with (0.10, "0.04, -0.04). Thus, if compared with what is shown in drawing 
21 , although the dissolution degree of a color blot is inferior, if compared with what is 
shown in drawing 20 , it turns out that the color blot is canceled further. 
[0099] Next, actuation of this operation gestalt which consists of the above-mentioned 
configuration is explained. The real image picturized by the digital still camera 12 
which has CCD of a veneer type is downloaded to a computer 21, and the case where it 
prints by the printer 31 is assumed. Then, first, by the basis on which operating system 
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21a is working by computer 21, image -processing application 21d is started and image 
data is incorporated from a digital still camera 12. If image data is incorporated by 
image-processing application 21d through this operating system 21a, while acquiring 
the index value for judging the size of an image based on (l) type at step Si 10, this 
index value is compared with a predetermined threshold, the size of the smoothing filter 
used at step S122 - step S126 and an unsharp mask is determined, and it saves in a 
work area. 

[0100] And a processing-object pixel is set as an initial position at step S130, and the 
value of deltaRB in a pixel and its circumference pixel concerned is computed according 
to (2) types. Then, based on (5) types, the value-change degree of ** deltaRB is 
investigated between a processing-object pixel and its circumference pixel at step S140, 
and when this change degree is large as compared with predetermined threshold Th, it 
is judged as a color blot pixel. 

[0 101] If judged as a color blot pixel, based on (6) - (8) type, the color difference 
components Cl and C2 will be computed about a processing-object pixel and its 
circumference pixel at step SI 50, and it will judge whether the color blot pixel 
concerned is an edge pixel in accordance with criteria, such as (9) and (10) types, or (ll) 
types. When it is judged as what is not an edge pixel, a smoothing filter equal to the 
filter size saved at step S122 - step S126 by step S152 in the work area is made to act 
here, namely, - the color difference " a component - C ■■ one - C " two " respectively - 
alike - attaching - smoothing - a filter - a grid - corresponding - a pixel - the color 
difference a component " totaling — a grid — a number — a division carrying out -- 
things -- data smoothing carrying out - having had — the color difference — a 
component - C " one - f - C " two " ' - obtaining . 

[0102] On the other hand, when it is judged at step S150 that the color blot pixel 
concerned is an edge pixel, the 5x5-pixel median filter centering on a same color blot 
pixel is made to act at step S154. That is, the value of a total of the 25-pixel color 
difference component centering on a color blot pixel is sorted in ascending order or 
descending order, a central, value is chosen, and it replaces with the color difference 
component of a color blot pixel. When the criterion of (9) and (10) types is adopted at 
step S150 at this time, a median filter is applied at step S154 about the color difference 
component which the color difference components Cl and C2 are alike, respectively, and 
satisfies this formula, and the above-mentioned smoothing filter is applied at step S152 
about the color difference component which does not satisfy this formula. Of course, in 
satisfying this formula about both color difference components in here, it applies a 
median filter about the both sides of the color difference components Cl and C2 at step 
S154. On the other hand, when adopting the criterion of (ll) types at step S150, a 
median filter will be applied to the both sides of the color difference components Cl and 
C2 at step S154. 

[0103] Then, the unsharp mask of the size determined at steps S122-S126 by step S160 
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is used, and it is [ a processing-object pixel and ] the low-frequency component 
Yunsharp of the brightness component Y about the circumference pixel. While asking, it 
is the original brightness component Y to this low-frequency component Yunsharp. By 
subtracting, it asks for a high frequency component, the high frequency component 
concerned is added to the brightness component Y of this dimension, and brightness 
component Y' after emphasis is obtained. Specifically based on (13) types etc., it will 
calculate, and -- this emphasis - the back -- brightness - a component Y - f - 
processing - the back - the color difference " a component - using - while - (-- six --) - 
(•- eight --) -- a formula being based -- data smoothing - the back R ' - G " 1 - B 
' -- gradation -- data - obtaining . It repeats until it judges that the above processing 
performed about all pixels at step S180, moving a processing-object pixel at step S170. 
[0104] The image data by which the image processing was carried out is displayed on a 
display 32 through display driver 21c, and if good, it will be made to print by the printer 
31 through printer driver 21b, if it finished performing about all pixels. That is, this 
printer driver 21b carries out color conversion of the rasterizing data from RGB to 
CMYK, changes it into binary data from the gradation data of CMYK after that, and is 
outputted to a printer 31 while it inputs the gradation data of RGB with which the color 
blot was reduced and performs rasterizing corresponding to the print head field of a 
printer 31 through predetermined resolution conversion. 

[0105] After an image processing is carried out and being displayed on a display 32 so 
that only the portion into which the color blot has generated automatically the real 
image data incorporated from the digital still camera 12 may reduce a color blot by the 
above processing, it is printed by the printer 31. That is, since an image processing is 
carried out so that only the portion which the color blot has generated may reduce a 
color blot, the amount of operations can be reduced and a high-speed image processing 
can be realized. 

[0106] Thus, while a processing-object pixel judges whether it is a color blot pixel based 
on the element color reinforcement of low density at steps S130 and S140, the computer 
21 which makes the center of an image processing When it judges with a color blot pixel, 
it judges whether it is an edge pixel at step S150. By making a smoothing filter act at 
step S152, when it is not an edge pixel, and making a median filter act at step S154, 
when it is another side and an edge pixel In order to carry out an image processing that 
a color blot should be reduced, the amount of operations can be reduced and a 
high-speed image processing can be performed. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing ll It is the block diagram of the image processing system which applied the 
image processing system concerning 1 operation gestalt of this invention. 
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[Drawing 2] It is the block diagram of the concrete hardware of this image processing 
system. 

[Drawing 3] It is the block diagram showing the easy example of a hardware 
configuration of a digital still camera. 

[Drawing 41 It is the outline block diagram showing other examples of application of the 
image processing system of this invention. 

[Drawing 5] It is the outline block diagram showing other examples of application of the 
image processing system of this invention. 

[Drawing 6] It is the flow chart which shows the judgment and image-processing portion 

of a color blot pixel in the image processing system of this invention. 

[Drawing 7l It is drawing showing the relation between image size and a smoothing 

field. 

[Drawing 81 They are 3x3, 5x5, and a 7x7 -pixel smoothing filter. 

[Drawing 9l It is drawing showing the relation between height and width in the image 
data of the number of the same pixels. 

[Drawing 10] It is drawing showing the condition of moving a processing-object pixel. 
[Drawing 111 difference [ in / for the change degree of an element color component / the 
contiguity pixel of the direction of slant ] — it is explanatory drawing in the case of 
asking with a value. 

[Drawing 12] difference [ in / for the change degree of an image / the contiguity pixel of 
the direction of slant ] — it is explanatory drawing in the case of asking with a value. 
[Drawing 131 It is explanatory drawing in the case of asking for the change degree of an 
image between [ adjoining all ] pixels. 

[Drawing 14] It is explanatory drawing of the modification which asks for the change 
degree of an image between the adjoining pixels. 

[Drawing 151 It is explanatory drawing of another modification which asks for the 
change degree of an image between the adjoining pixels. 

[Drawing 16] It is drawing showing an example of the color difference component value 
of each pixel in the image data of the edge portion containing a color blot pixel. 
[Drawing 17] It is drawing for explaining an example of data processing by the median 
filter. 

[Drawing 18] They are 3x3, 5x5, and a 7x7-pixel unsharp mask. 

[Drawing 19] It is drawing showing the relation between a smoothing field and an edge 
enhancement field. 

[Drawing 20] It is the table showing the value of the various parameters in the single 
dimension simulation model when not performing edge enhancement processing. 
[Drawing 21] It is the table showing the value of the various parameters in the single 
dimension simulation model at the time of performing edge enhancement processing 
using the unsharp mask of the same size as a smoothing filter. 

[Drawing 221 It is the table showing the value of the various parameters in the single 
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dimension simulation model at the time of performing edge enhancement processing 

using the unsharp mask of size smaller than a smoothing filter. 

[Drawing 23] It is drawing for explaining the generating principle of a color blot. 

[Description of Notations] 

10 - Picture input device 

20 - Image processing system 

21 Computer 

21a - Operating system 

21b ~ Printer driver 

21c " Display driver 

2 Id - Image-processing application 

22 ~ Hard disk 

23 - Keyboard 

24 ■• CD-ROM drive 

25 " Floppy disk drive 

26 - Modem 

30 - Image output unit 
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